Unit C1 
Linear equations and matrices 


Introduction to Book C 


Systems of linear equations in several variables arise in areas as diverse as 
science, technology and economics. The solutions to such systems can 
provide answers to a wide range of problems, from supply and demand 
dependencies in economics to working out currents in electrical networks. 
Apart from such practical applications, solving systems of linear equations 
is also an interesting mathematical problem in itself. Much effort has been 
devoted to solving systems of linear equations. You will see that this 
process is not always straightforward, especially if the number of variables 
is large. 


One key issue is whether a given system of linear equations has any 
solutions at all. As a specific example of the types of situation that may 
occur, consider the following three rather similar pairs of linear equations 
in the variables x and y. 


r+ 3y=5 -z + 3y=5 -x + 3y =1 
=27 + 6y = 2 —22 + 6y = 2 —2x2 + 6y = 2 


The first pair of equations has the unique solution x = 2, y = 1, whereas 
the second pair has no solutions, and the third pair has infinitely many 
solutions (for example, x = —1, y = 0, and z = 0, y= 2). You will see that 
these different outcomes may be understood: 


e algebraically, by studying the matrix of coefficients of the equations, and 
introducing a function of these coefficients, called the determinant 


e geometrically, by interpreting solutions of the equations as points of 
intersection of the corresponding pairs of straight lines drawn in an 
(x, y)-plane. 


The algebraic approach as well as the geometric approach can be 
generalised for systems of linear equations that involve more than two 
variables. The geometric approach will require us to use a generalisation of 
the plane called n-dimensional Euclidean space, whose elements are of the 
form (£1, £2,..., En), where 21, £2,..., £n are real numbers. Depending on 
the context, we will interpret these elements as either points or vectors in 
Euclidean space. Although it is only easy to visualise objects in 
n-dimensional space when n = 1, 2 or 3, this more general Euclidean space 
is a convenient environment in which to develop the theory needed to 
analyse the solutions of systems of linear equations. 


You will see that a key tool in this theory is the concept of a linear 
transformation which, in its basic form, is a function from one Euclidean 
space to another that preserves certain aspects of the geometric structure 
of the Euclidean space. For example, the function 


t(x, y) = (x + 3y, —2x + 6y) 


is a linear transformation from R? to R?, which is closely related to the 
first pair of equations above. Indeed, solving that pair of equations is 
equivalent to finding a point (x,y) in R? such that the function t maps 
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(x,y) to the point (5,2). This suggests that we can obtain information 
about the solutions of systems of linear equations by studying the 
corresponding linear transformations. 


But linear transformations arise in situations apart from that of solving 
equations. For example, they are needed to manipulate computer graphic 
images, as illustrated in Figure 1. 
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Figure 1 The effect of a rotation, reflection and shear on an image 


Finally, the range of available linear transformations can be increased 
greatly by introducing the notion of a vector space. This is a generalisation 
of n-dimensional Euclidean space, and it may be finite-dimensional or 
infinite-dimensional. The elements of a vector space are sometimes called 
vectors, but they can be very general objects; for example, you will look at 
vector spaces whose elements are real functions, and linear transformations 
between such vector spaces that arise from operations on real functions 
such as differentiation and integration. In this way, vector spaces and their 
associated linear transformations form a very general context in which 
many seemingly unrelated problems can be studied using similar 
techniques. 


In this book on linear algebra you will learn about all these concepts: 
solving systems of linear equations, matrices, vector spaces and linear 
transformations. You will also use this theory to classify conics and 
quadrics. 


Introduction 


In this first unit of linear algebra you will begin by considering systems of 
linear equations in two and three unknowns. You will then see how 
matrices can be used as a concise way of representing systems of linear 
equations, before going on to study matrices themselves. You will see how 
properties of the matrix of coefficients may be used to quickly determine 
whether the system of linear equations has a unique solution. 


Many of the ideas and methods you will meet in this unit will also be used 
in the subsequent three units on linear algebra. 


1 Systems of linear equations 


In this section you will revise systems of linear equations in two and three 
unknowns and see how these ideas extend to systems in more unknowns. 


Recall that a system of linear equations in two (or three) unknowns is 
a collection of linear equations each written in terms of a set of two (or 
three) unknowns. A solution to a system of linear equations is an 
assignment of values to the unknowns that makes all the equations hold 
simultaneously; therefore such a system is also called a system of 
simultaneous linear equations in the given set of unknowns. 


1.1 Systems in two and three unknowns 


Systems in two unknowns: one equation 


In Unit Al Sets, functions and vectors, you saw that an equation of the 
form 


ax+by=c 


where a, b and c are real numbers, and a and b are not both zero, 
represents a line in R?. There are infinitely many solutions to this 
equation — one corresponding to each point on the line. 


Systems in two unknowns: two equations 


The solutions to the following system of two linear equations 


ax + by=c 
dz + ey = f 


in the two unknowns x and y, where a,b,..., f are real numbers, 
correspond to the points of intersection of these two lines in R?. 


Now, two arbitrary lines in R? may intersect at a unique point, be parallel, 
or coincide, which means that solving a system of two linear equations in 
two unknowns yields exactly one of the following three situations. 


e There is a unique solution, when the two lines represented by the 
equations intersect at a unique point, as illustrated in Figure 2. 


For example, the system 
z — y= -l1 
2r+y=4 
has the unique solution « = 1, y = 2, corresponding to the unique point 
of intersection (1,2) of the two lines in R?. 
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Figure 2 Two lines 
intersecting at a unique point 
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Figure 3 Two parallel lines 
with no point of intersection 


ae 


Figure 4 Two coincident lines 


Figure 5 Two parallel planes 


e There is no solution, when the two lines represented by the equations are 
parallel, as illustrated in Figure 3. 


For example, the system 

z-y=-l 

L-y= 
represents two parallel lines in R? that do not intersect, and so the 
system has no solution. 


e There are infinitely many solutions, when the two lines represented by 
the equations coincide, as illustrated in Figure 4. 


For example, the system 
—6xz + 3y = -6 
22 — y=2 


has infinitely many solutions, as the two equations represent the same 
line in R?: the equations are a multiple of one another. In a sense, the 
two lines intersect at all of their points; that is, each pair of values for x 
and y satisfying 2x — y = 2 is a solution to this system. 


Systems in three unknowns: one equation 
In Unit Al you saw that an equation of the form 
ax +by+cz=d 


where a, b, c and d are real numbers, and a, b and c are not all zero, 
represents a plane in RÌ. There are infinitely many solutions to this 
equation — one corresponding to each point in the plane. 


Systems in three unknowns: two equations 
The solutions to the system of two linear equations 


ax + by+cz=d 
ex + fy+qz=h 


in the three unknowns x, y and z, where a,b,..., are real numbers, 
correspond to the points of intersection of these two planes in R?. 


Two arbitrary planes in R? may intersect, be parallel or coincide. In 
general, when two distinct planes in R® intersect, the set of common points 
is a line that lies in both planes. This means that solving a system of two 
linear equations in three unknowns yields exactly one of the following two 
situations. 


e There is no solution, when the two planes represented by the equations 
are parallel, as illustrated in Figure 5. 


For example, the system 


ertytz=1 
erty+tz2=2 


represents two parallel planes in R? and so has no solutions. 


e There are infinitely many solutions, when the two planes represented by 
the equations coincide, or when they intersect in a line, as illustrated in 
Figures 6 and 7, respectively. 


For example, 


t+ y+ z=1 
2x + 2y+2z=2 


has infinitely many solutions, as the two equations represent the same 
plane in R. Each set of values for x, y and z satisfying x + y + z = 1 is 
a solution to this system, such as x = 1, y = 0, z =O and z = —2, y = 4, 
z=-l. 


Similarly, the system 


r+y+z=1 
r+ Yy = 


has infinitely many solutions: the planes in R? represented by the two 
equations intersect in a line. The z-coordinate of each point on this line 
is zero, and so the line lies in the (x, y)-plane. Each set of values for x, y 
and z satisfying xz + y = 1 and z = 0 is a solution to this system, such as 
r=l1,y=0,z=Oandr=5,y=—4,z=0. 


Systems in three unknowns: three equations 


In a similar way, the solutions to the system of three linear equations 


ax + by+ cz =d 
ex + fytgz=h 
ix + jytkz=l 


in the three unknowns z, y and z, where a,b,...,/ are real numbers, 
correspond to the points of intersection of these three planes in R3. 


Three arbitrary planes in R? may meet each other in a number of different 
ways. We illustrate these possibilities below. A system of three linear 
equations in three unknowns yields exactly one of the following three 
situations. 


e There is a unique solution, when the three planes represented by the 
equations intersect at a unique point, as illustrated in Figure 8. 


For example, the system 


rty+tz=1 
cr+y =1 
x =g = 


has the unique solution æ = 0, y = 1, z = 0, corresponding to the unique 
point of intersection (0, 1,0) of the three planes in R°. 
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Figure 6 Two coincident 
planes 


Figure 7 Two planes 
intersecting in a line 


Figure 8 Three planes 
intersecting in a unique point 
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e There is no solution, when two (or three) of the planes represented by 
the equations are parallel, or when the three planes form a triangular 
prism, as illustrated in Figures 9 and 10, respectively. 


For example, the system 


rtyt+tz=1 
Figure 9 Three planes, two of gE+ytz=2 
which are parallel rty-z=0 


represents three planes in RÌ, the first two of which are parallel, and so 


the system has no solutions. 
Similarly, the system 
c+y =1 
i +z=1 
—ytz=1 


Figure 10 ‘Three planes 


; co. f ; has no solutions: the planes in R? represented by the three equations 
intersecting in pairs forming a 


intersect in pairs, forming a triangular prism, and so there are no points 
common to all three planes. 


e There are infinitely many solutions, when the three planes that the 
equations represent intersect either in a plane or in a line, as illustrated 


prism 
in Figures 11 and 12, respectively. 
For example, the system 
r+ yt Z= 


x y z=-—1 
2r + 2y +22 =2 


Figure 11 Three coincident 


has infinitely many solutions, as the three equations all represent the 


same plane in R3: the equations are multiples of one another. Each set 
of values for x, y and z satisfying x + y + z = 1 is a solution to this 
system, such as x= 1, y = 0, z = 0 and z = —1, y = 3, z=-1. 
Similarly, the system 
ertytz=1 
=] 


Figure 12 Three planes Z+y-Zz= 
intersecting in a line 


has infinitely many solutions: the planes in R? represented by the three 

equations intersect in a line. The z-coordinate of each point on this line 

is zero, and so the line lies in the (x, y)-plane. Each set of values for x, y 
and z satisfying z + y = 1 and z = 0 is a solution to this system, such as 
z=l,y=0,z=0andr=—5, y=6, z=0. 


© 


1.2 Systems in n unknowns 


The equations for a line in R? and a plane in R are linear equations in 
two and three unknowns, respectively. Similarly, an equation of the form 


ax + by + cz + dw = e 


is a linear equation in the four unknowns 2, y, z and w, where a,...,e are 
real numbers, and a, b, c and d are not all zero. In general, we can define a 
linear equation in any number of unknowns. 


Definitions 


An equation of the form 
a1 21 + Goto +--+ + anTn = b, 


where a1, @2,...,@n,6 are real numbers, and aj,...,@p are not all 
zero, is a linear equation in the n unknowns z1, £2, ..., £n. The 
numbers a; are the coefficients, and b is the constant term. 


A linear equation has no terms that are products of unknowns, such as z? 


Or Y1X4. 


Exercise C1 


Which of the following are linear equations in the five unknowns 
Tl; SPET 
(a) £1 + 3x9 — £3 — 5x4 — 245 = 0 (b) £1 — T2 + 24%3%44+ 345 = 4 


(c) 5x2 — z5 = 2 (d) azı + azr? +--+ asz? =b 


We write a system of linear equations, or more precisely a general system 
ofm linear equations in n unknowns, as 


11%, + ayo%g +--+ + Aintn = b1 
G21%1 + a22£2 +++ + Amnn = b2 


Ami 21 + Am2%2 + +++ + Amntn = bm. 


The numbers b; are the constant terms, the variables x; are the unknowns 
and the numbers a;j are the coefficients. We use the double subscript ij to 
show that a;; is the coefficient of the jth unknown in the ith equation. 
The number m of equations need not be the same as the number n of 
unknowns. 


A solution of a system of linear equations is a list of values for the 
unknowns that simultaneously satisfy each of the equations. In solving a 
system, we look for all the solutions — you have already seen that some 
systems have infinitely many solutions. 


1 Systems of linear equations 
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Definitions 
The values 71 = cj, £2 = C2, ..., Ln = Cn are a solution of a system 
of m linear equations in n unknowns, denoted by 71,...,2n, if these 


values simultaneously satisfy all m equations of the system. The 
solution set of the system is the set of all the solutions. 


For example, you saw earlier that the system 


eHpy thet 
z+y = 1 (1) 
T = 7 =, 


has the unique solution x = 0, y = 1, z = 0 corresponding to the unique 
point of intersection (0,1,0) of the three planes represented by these 
equations. We can write the solution set of this system as the set 
{(0,1,0)}, which has just one member. 


You also saw that the system 


r+y+z=1 
r+y+z=2 (2) 
et+y—z=0, 


has no solutions, so its solution set is the empty set. 


Definitions 


A system of linear equations is consistent when it has at least one 
solution, and inconsistent when it has no solutions. 


The system (1) is consistent, and the system (2) is inconsistent. 


When a system of linear equations has infinitely many solutions, we can 
write down a general solution from which all solutions can be found as 
follows. 


You saw earlier that the solutions of the system 


etytpe=1 
r +y = 
e+ty-z=1 


are the sets of values for x, y and z satisfying « + y = 1 and z = 0. The 
unknowns x and y are related by the equation « + y = 1, which we can 
rewrite as y = 1 — x. Thus for each real parameter k assigned to the 
unknown x, we have a corresponding value 1 — k for the unknown y. We 
write this general solution as 


c=k, y=1-k, z=0, wherekeR. 
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To highlight the connection between the solutions of the system and the 
intersection of the planes in RÌ, we can write the solution set as a set of 
points in R3: 

{(k,1—k,0) € R® :k ER}, 
which we usually abbreviate to 

{(k,1—k,0):k eR}. 


Note that the order of the unknowns x, y, then z matters: the triples 
(1,0,0) and (0,1,0) correspond to different solutions. We could have 
assigned parameters differently and obtained alternative ways of writing 
down the solution set. For example, if we assign the real parameter p to 
the unknown y and rewrite the equation x+y = 1 as x = 1 — y, we get 


{(1 — p, p, 0) :PE R}. 


Homogeneous systems 


In the following systems of linear equations, the constant terms are all zero: 


2x + 3y = 0 

g= y=), (3) 
z-y—z=0 

22 +y—z=0 (4) 
-trt +y+z=0. 


Such systems are called homogeneous. 


Definitions 


A homogeneous system of linear equations is a system of linear 
equations in which each constant term is zero. 


A system containing at least one non-zero constant term is a 
non-homogeneous system. 


If we substitute z = 0, y = 0 into system (3), and x = 0, y = 0, z = 0 into 
system (4), then all the equations are satisfied. These solutions are called 
trivial. 


Definitions 


The trivial solution to a system of homogeneous linear equations is 
the solution in which each unknown is equal to zero. 


A solution with at least one non-zero unknown is a non-trivial 
solution. 


A homogeneous system always has at least the trivial solution, and is 
therefore always consistent, whereas non-homogeneous systems have only 
non-trivial solutions or may be inconsistent. 
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Exercise C2 


Write down a general homogeneous system of m linear equations in n 
unknowns, and show that the solution set contains the trivial solution. 


Returning to system (4), we see that there are other solutions, unlike 
system (3) which has no non-trivial solutions. For example, z = 2, y = —1, 
z = 3 is a solution to system (4). In fact, this system has an infinite 
solution set because the first and third equations are multiples of one 
another. Geometrically, the three planes represented by these equations 
intersect in a line. Figure 7 illustrates this situation, as the planes 
represented by the first and third equations coincide. The solution set can 
be written as {(2k, —k, 3k) : k € R}. 


Number of solutions 


In Subsection 1.1 you saw that when m < n < 3, a system of m equations 
in n unknowns has a solution set which either 


e contains exactly one solution, 
e is empty, or 
e contains infinitely many solutions. 


(When m = n = 1 we have one equation of the form ag = b, which has a 
unique solution.) 


In fact, as you will see in Unit C3 Linear transformations, the solution set 
of a system of m linear equations in n unknowns has one of these forms, 
for any natural numbers m and n. 


We observed earlier that two non-parallel planes in R? intersect either in a 
line or in a plane, so cannot intersect at a unique point. A consistent 
system of two linear equations in three unknowns therefore has an infinite 
solution set. In general, a consistent system of m equations in n unknowns, 
with m < n, has insufficient constraints on the unknowns to determine 
them uniquely; that is, it has an infinite solution set. 


1.3 Solving systems 


We now introduce a systematic method for solving systems of linear 
equations. This method is called Gauss-Jordan elimination. It entails 
successively transforming a system into simpler systems, in such a way 
that the solution set remains unchanged. The process ends when the 
solutions can be determined easily. You will meet this method again in 
Section 2, where you will use matrices to represent systems of linear 
equations. A strategy for solving systems of linear equations using 
Gauss-Jordan elimination is given there. 


1 Systems of linear equations 


The Gauss—Jordan elimination method was introduced by the 
geodesist Wilhelm Jordan (1842-1899) in the third edition of his 
Handbuch der Vermessungskunde (Handbook of Surveying) in 1888. In 
the same year the rather more obscure Luxembourg mathematician 
turned abbot Bernard Isidore Clasen (1829-1902) independently 
described the method, but his work did not become widely known. 
The method’s association with Carl Friedrich Gauss (1777-1855) is 
due to the fact that it can be regarded as a modification of the 
method of Gaussian elimination. Wilhelm Jordan is not to be 
confused with the algebraist Camille Jordan (1838-1922). 


The idea of Gauss-Jordan elimination is to reduce the number of 
unknowns in each equation. In general, we use the first equation to 
eliminate the first unknown from all the other equations, then use the 
second equation to eliminate another unknown (usually the second) from 
all the other equations, and so on. The actual order in which the 
unknowns are eliminated is flexible; however, it is sensible, at least 
initially, to proceed in order to avoid making mistakes. 


Wilhelm Jordan 


To avoid confusion when applying this method, we label the current 
equations r1, r2, and so on. This notation will be used in Section 2 where 
we transform rows of matrices, hence the choice of the letter r. 


We can then write down how we are transforming the preceding system to 
obtain the current (simpler) system. We use the symbol + (‘interchanges 
with’) to indicate that two equations are to be interchanged; for example, 
rı © rə means that the first and second equations are interchanged. We 
use the symbol —> (‘goes to’) to show how an equation is to be 
transformed. For example, rə + ro + rı means that the second equation of 
the system is transformed by adding the first equation to it. 


We start by illustrating this method with a system of two linear equations 
in two unknowns. Although this method is not the simplest way of solving 
this particular system, it proves very useful in solving more complicated 
systems. It is important that the operations we perform do not alter the 
solution set of the system. 


Worked Exercise Cl 


Solve the following system of two linear equations in two unknowns. 


2x + 4y = 10 
4dr + y=6 
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Solution 


@. We aim to simplify the system by eliminating the unknown y, or 
y-term, from the first equation and the unknown z, or x-term, from 
the second; that is, we aim to obtain equations of the form x = x, 
y = *, where the asterisks denote numbers to be determined. .© 


We label the two equations of the system. 
Di 2x + 4y = 10 
19 4r+ y=6 

We simplify the first equation. 


@. We divide it through by 2, so that the coefficient of x is equal 
to 1. & 


rı > iri z+2y=5 
Ami a) 
®. At each step, we relabel (implicitly) the equations of the current 
system. These two equations therefore become the new rı and ro. ® 
We then eliminate the x-term in the second equation. 
@. We subtract 4 times the first equation from the second. © 
xt 2y =5 
r2 > ro — 4rı — Ty = —14 
We now simplify the second equation of this new system. 


®. We divide it through by —7; this yields a system which already 
looks less complicated than the original system, but has the same 
solution set. © 
x+2y=5 
ia) —tre y = 2 
Next we eliminate the y-term from the first equation. 
®. We subtract twice the second equation from the first. .© 
rı > rı — 2r2 g=] 
y=2 
We conclude that there is a unique solution: « = 1, y = 2. 


@®. As a check: we substitute x = 1 and y = 2 in the original system, 
using the abbreviation LHS for the left-hand side of the original 
equations and RHS for the right-hand side: 

LAS = 2x1) (4 2) = 10 = RHS y 

Lis = (4x1) 2) = = RES. N 
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The steps we performed in the worked exercise above involve either 
multiplying (or dividing) an equation by a non-zero number, or changing 
one equation by adding (or subtracting) a multiple of another. Neither of 
these operations alters the solution set of the system. Changing the order 
in which we write down the equations also does not alter the solution set 
of the system. These are the three operations, called elementary 
operations, that we perform to simplify a system of linear equations when 
using the method of Gauss—Jordan elimination. 


Elementary operations 


The following operations do not change the solution set of a system of 
linear equations. 


1. Interchange two equations. 
2. Multiply an equation by a non-zero number. 


3. Change one equation by adding to it a multiple of another. 


Operation 2 includes division by a non-zero number, and operation 3 
includes subtracting a multiple of one equation from another. 


In symbols we represent these three elementary operations by 
ri © rj, ry ari, and r; —r;+ prj, 


respectively, where a, 3 are non-zero numbers. 


Exercise C3 


Perform elementary operations, as in Worked Exercise C1, to solve the 
following system of two linear equations in two unknowns. 


ety=4 
2x —-y=5d 


We now solve a system of three linear equations in three unknowns. We 
use elementary operations to try to reduce the system to the following 
form, where again the asterisks denote numbers to be determined. 


Toe 
y=* 
Z=* 
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Worked Exercise C2 


Solve the following system of three linear equations in three unknowns. 
r+ y+2z=3 
2x + 2y+3z=5 
Z- y =5 


Solution 


We label the three equations and apply elementary operations to 
simplify the system. 


rı r+ y+2z=3 
r2 Bae se 2) sp Be = 
r3 w= p = 5 


@. We eliminate the x-term from the second and third equations: we 
subtract twice the first equation from the second, and then subtract 
the first from the third. © 


r+ y+ 2z=3 
r2 > r2 — 27) —z = —1 
Poe — 1) — 2y — 2z =2 


@. We now have no y-term in the second equation, and so cannot use 
this equation to eliminate the y-term from the first and third 
equations. We also cannot use the first equation to eliminate the 
y-term from the third equation, as this would reintroduce an x-term. 
However, we can use the third equation to eliminate the y-term from 
the first equation. To keep the terms in order we interchange the 
second and third equations — this is not strictly necessary, but helps 
keep things in order. ® 


r+ y+ 2z=3 
ro > r3 —2Qy—-— 2z=2 
=f ==] 


@®. We simplify this new second equation by dividing it through 
by —2. # 


est Qe=3 
ry > —4r> QAP z=—-l 
—z=-1l1 


®. We eliminate the y-term from the first equation by subtracting the 
second equation from the first. .©@ 


ify 2 ry = ie as el 
Yar gel 
=z = = 


Exercise C4 


Solve the following system of three linear equations in three unknowns. 
r+ y- z=8 
2e-—- yt z= l 
=T + 3y + 2z = —8 


Each system solved so far in this subsection has a unique solution. We now 
show how to apply the method to a system that does not have a unique 
solution. 


It is not usually possible to reduce a system with an infinite solution set to 
one where each equation contains just one unknown. This is illustrated by 
the following worked exercise. 


Worked Exercise C3 


Solve the following system of three linear equations in three unknowns. 
t + 2y = 0 
y-z= 2 
r+ ytz=-2 
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Solution 


We label the three equations and apply elementary operations to 
simplify the system. 


Yr Go, cy 0 
r2 y=: =? 
r3 r+ y+z=-2 


@. We eliminate the x-term from r3 using rı. ® 


x+ 2y = 0) 
Yr eS 
ips, =y ia = TP} —y +z = -2 


®. We eliminate the y-terms from rı and r3 using ro. © 


rı > rı — 2r2 L + 2z = —4 
y= z=2 
r3 > r3 +r2 Oke = Oy ae Oe = 0 


®. The current r3 equation gives no constraints on z, y and z: any 
values for x, y and z satisfy it. 


If we were to try to use equation rə to eliminate the z-term from rj, 
we would introduce a y-term. Similarly, using equation rı to eliminate 
the z-term from the equation rə would reintroduce an 2-term. .& 


There are insufficient constraints on the unknowns to determine them 
uniquely; so the system has an infinite solution set. 


®. We have two equations, one (x = —4 — 2z) relating the unknowns 
x and z, and the other (y = 2 + z) relating y and z. 


As each equation involves a z-term, we can choose any value we wish 

for z and use the equations to find the corresponding values for x and 
y in terms of this value for z. We set z equal to the real parameter k 

to get a general solution. © 


We write the general solution as 


a=-4-2k, y=2+k, z=k, KER. 


In the worked exercise above the equation r3 was written as 

Ox + Oy + 0z = 0 to highlight the fact that all the coefficients are zero — in 
future we will simply write the equivalent equation 0 = 0. In this case, the 
original equation r3 did not give rise to any additional constraints not 
already given by rı and ro. 


Whenever the simplification results in an equation 0 = 0, we have, in 
effect, reduced the number of equations. We simplify the remaining 
equations as far as possible, in order to determine the solution set. 


Exercise C5 


Solve the following system of three linear equations in three unknowns. 


zr +3y— z=4 
—r + 2y — 4z = 6 
æ+ 2y =2 


We now try to solve an inconsistent system. 


Worked Exercise C4 


Solve the following system of three linear equations in three unknowns. 
z + 2y +4z=6 

y+ z=1 

x + 3y + 5z = 10 


Solution 


We label the three equations and apply elementary operations to 
simplify the system. 


rı T 2yj ae le = 6 
r2 al 
r3 a2 4p w sp Oz = 10 


@. We eliminate the x-term from r3 using rı. © 


xr + 2y +4z=6 
y+ z=1 
er = Tey — i y+ z=4 


®. Comparing r2 and r3, we can conclude at this point that the 
system is inconsistent or we can carry out one further step to 
eliminate the y-terms from rı and r3 using ro. © 


rı > rı — 2ro x +2z=4 
y+ z=1 
Vee) ze e | ip) Q=3 


®. Concentrating on the current r3 equation (0 = 3), we see that 
there are no values of x, y and z that satisfy it. This system has no 
solutions. .& 


This system of linear equations is inconsistent: the solution set is the 
empty set. 


1 Systems of linear equations 
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Whenever the simplification results in an equation 0 = *, where the 
asterisk « denotes a non-zero number, we have an inconsistent system, 
since such an equation has no solutions. There is no point in simplifying 
the remaining equations further. As indicated in Worked Exercise C4, 
inconsistency of the system could have been inferred at the penultimate 
stage, as the equations y+ z = 1 and y+ z = 4 form an inconsistent 
system. 


Exercise C6 


Solve the following system of three linear equations in three unknowns. 


c+yt+t z=6 
—x+y-—3z=-2 
22 +y+3z=6 


1.4 Applications 


Systems of linear equations frequently arise when we use mathematics to 
solve problems from both within mathematics and outside it. 


The following worked exercise illustrates how linear equations can be used 
to find the equation of a plane through three given points. 


Worked Exercise C5 


Determine the equation of the plane that contains the three points (1, 3,1), 
(1,5,2) and (2,2,1). 


1 Systems of linear equations 


@. We eliminate the a-term from rə and r3 using rı. © 


a+3b+c=d 
Tes) ae Tey = TS) 2b+c=0 
r3 > r3 — 2r; — 4b- c= -d 
@. We simplify ro. ® 
Cao C= u 
ro > $rv b+ 4c=0 
= = e= =ü 


®. We eliminate the b-term from rı and r3 using ro. ® 


rı > rı — 3r2 a - ġc=d 
b+3c=0 
r3 > r3 + 4r2 c=-d 


®. We eliminate the c-term from rı and rz using r3. ® 


rı > rı + $r3 a=sd 
r2 > ro — 573 b= ¿d 
c=-d 


We conclude that this system has a unique solution (in terms of d): 
= 5d, D= 5d, c= d. 


We substitute these expressions into the equation of the plane to get 
idx + dy — dz = d. 
Multiplying through by 2 and dividing through by d yields a simpler 
equation for the plane: 
6 =F Y= 22 = 2, 


@®. As a check: we substitute the coordinates of each of the three 
points into this equation for the plane 
LHS = (Us Wee x3) = (2 x 1) = 2 = Ris 
LHS =(1x1)4+(1x5)—=@x2)=2=RES,7 © 
LHS = (1 x 2) + (1x2) — (2x 1) =2 = RS. ¥ 


Exercise C7 


Determine the equation of the plane that contains the three points (1,0, 2), 
(0,3,4) and (1, 1,3). 


The final exercise in this section uses systems of linear equations to solve a 
different type of problem. The idea is to use the information given to write 
down two linear equations that simultaneously hold, and then to solve 
these to answer the question. 
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Exercise C8 


The sum of the ages of my sister and my brother is 40 years. My brother is 
12 years older than my sister. How old is my sister? 


Because Gauss—Jordan elimination is a systematic method for solving 
systems of linear equations, it is straightforward to automate. Hence 
large systems of linear equations involving many variables can be 
easily solved using computers. Such systems are used in some 
methods of weather forecasting, as well as systems of non-linear 
equations. Gauss—Jordan elimination also arises in coding theory, 
which underpins digital communication and data transmission. 


2 Row-reduction 


In this section you will see how the method of Gauss—Jordan elimination 
can be applied using matrices, and that it can be formalised into a strategy 
that can be followed step by step. This method makes it easy to solve even 
quite large systems of linear equations. It involves a technique 
(row-reduction) that will be useful in another context later in this unit 
when we look at inverses of matrices. 


2.1 Augmented matrices 


We begin by using matrices as an abbreviated notation for a system of 
linear equations. 


A matrix is simply a rectangular array of objects, usually numbers, 
enclosed in brackets; in this module we use round brackets for matrices, 
although some texts use square ones. 


The objects in a matrix are called its entries. The entries along a 
horizontal line form a row, and those down a vertical line form a column. 
A matrix with m rows and n columns is an m x n matrix, and we say that 
it is a matrix of size m x n. 


A zero row of a matrix is a row comprising entirely of zeros, and a 

non-zero row has at least one non-zero entry. The first non-zero entry in 
a row (reading from left to right) of a matrix is the leading entry of that 
row; when such an entry in a row is the number 1, it is called a leading 1. 


Here are some examples of matrices with some entries highlighted as 
explained below: 


J 
A d 3.17 223 7.05 0.00 : 7 
2 P 4.88 1.71 1.72 5.55)’ 
0 0 0 0 B 


The entries in the first row of the first matrix above are 2 and —7; the 
entries in the second column of the second matrix above are 2.23 and 1.71; 
the 1 in the second row of the third matrix is a leading 1, and the —5 in 
the third row of this matrix is a leading entry. 


We can abbreviate a system of linear equations by writing its coefficients 
and constants in the form of a matrix. For example, the system 
4g + y=-T 
g= 3y=0 


can be abbreviated as 


4 1/-7 
1 -3| O/° 
It is helpful to draw the vertical line separating the coefficients of the 


unknowns on the left-hand sides of the equations from the constants on the 
right-hand sides. 


In general, the system 


1121 + aizo +++ + Qintn = b1 
G12, + ag2%g + +++ + Amn = b2 


Omi li + Opole + `- + amnin = bm 


of m linear equations in n unknowns z1, %2,..., £n is abbreviated as the 
matrix 

aii a2 ain | by 

a21 Q2 a2n | be 

AmI Am2 ‘** Amn bm 


This matrix is called the augmented matrix of the system. The word 
augmented reflects the fact that it is made up of a matrix formed by the 
coefficients of the unknowns on the left-hand sides of the equations, 
augmented by a matrix (or column vector) formed by the constants on the 
right-hand sides. Later, we will sometimes consider these two matrices 
separately. 


In the augmented matrix each row corresponds to an equation, and each 
column (except the last) corresponds to an unknown, in the sense that it 
contains all the coefficients of that unknown from the various equations. 
The last column corresponds to the right-hand sides of the equations. 


Worked Exercise C6 


Write down the augmented matrix of the following system of linear 
equations. 


i +10z=5 


3r + y-— 4z=-1 
4g —2y+ 6z=1 
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Worked Exercise C7 


Write down the system of linear equations corresponding to the following 
augmented matrix, given that the unknowns are, in order, 21, £2. 


1 -—2)5 
0 149 
4 30 


Exercise C9 


(a) Write down the augmented matrix of the following system of linear 


equations. 
Aa, = 2x9 =- 
t+ 3z3 = 0 
— 3272+ 73=3 


(b) Write down the system of linear equations corresponding to the 
following augmented matrix, given that the unknowns are, in order, 


L,Y, Z, W. 
2 3 0 7| 1 
© 1 -= Qj|=1 
1 0 3 -1 
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2.2 Elementary row operations 


When you used Gauss-Jordan elimination to solve a system of linear 
equations in Section 1, you worked directly with the system itself; but it is 
often easier to apply the same method to its abbreviated form, the 
augmented matrix. The three elementary operations on the equations of 
the system correspond exactly to three equivalent operations on the rows 
of its augmented matrix. 


Recall that the three elementary operations are as follows. 

1. Interchange two equations. 

2. Multiply an equation by a non-zero number. 

3. Change one equation by adding to it a multiple of another. 


These correspond to the following operations on the rows of the augmented 
matrix. 


Elementary row operations 
1. Interchange two rows. 
2. Multiply a row by a non-zero number. 


3. Change one row by adding to it a multiple of another. 


We call these operations the elementary row operations of types 1, 2 
and 3, respectively. 


The next worked exercise shows a system of linear equations solved by 
Gauss-Jordan elimination. In Worked Exercise C2 we solved this system 
by performing elementary operations on the system itself; here we perform 
the corresponding elementary row operations on the augmented matrix of 
the system. You can see that here we have less to write down at each stage. 


In this worked exercise, and elsewhere, we use the same notation for 
elementary row operations as we use for elementary operations (r; + rj, 
and so on). 


Worked Exercise C8 


Solve the following system of linear equations. 


e+ yt+t2z=3 
24+ 2y+3z=5 
Z- y =5 


Solution 


We perform a sequence of elementary row operations on the 
augmented matrix of the system. 
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®. The idea is to transform the augmented matrix into one of a 
system with the same solution set but whose solution set is easy to 
write down. © 


Gi 1 l 2) 
ro 2 2 32 
r3 1 =1 olg 

1 1 2 3 
rə > ro — 2rı 0 0 —1|—1 
r3 => r3 = Fj 0 -2 -2 2 


Ly) Se 1G 


| 
| 
eee 
| 
| 


oOo Ff 
l 
N 
l 
N 
N 


1 1 2 3 
0 1 1} -1 
0 0 -1|-1 
LO ae PT 16) 1 0 il 4 
0 1 1} -1 
0 0 -1|-1 
1 0 il 4 
0 il 1} -1 
VERY are o 0 0 il il 
1S) ze 1, eS 1 0 0 3 
O o — 18s 0 1 0| —2 
0 0 1 1 


The corresponding system i 


n 


a =3 
Yea 2 
B= I. 
The unique solution is x = 3, y= —2, z=1. 


It is important to appreciate the following point about elementary row 
operations. 


When a sequence of elementary row operations is performed on a matrix, 
each row operation in the sequence produces a new matrix, and the 
following row operation is then performed on that new matrix. For 
example, the working for the first two row operations in the solution to the 


worked exercise above should, strictly, be set out as follows. 


rı 1 1 2/3 
r2 2 2 3ļ5 
rs 1 -1 O15 

1 1 2 
to > ro — 2r1 0 0 -1/-1 

1 =l 0 

1 1 2 

0 0 =1|-=l 
rs r3= fi 0 -2 -2 


However, we often perform two or more row operations in one step, to save 
time. Whenever we do this, we must ensure that when a row is changed by 
one of these row operations, the new version of that row is used when 
performing later row operations. 


The easiest way to avoid difficulties is to perform two or more row 
operations in one step only if none of these row operations changes a row 
that is then used by another of these row operations. The above row 
operations rg > ro — 2rı and r3 > r3 — rı meet this criterion: the first 
changes only row 2, and the second does not involve row 2. In this module 
we perform two or more row operations in one step only if they meet this 
criterion. 


Row-sum check 


We end this subsection by describing a simple checking method that can 
be useful for picking up arithmetical errors when we perform a sequence of 
elementary row operations on a matrix by hand. 


To apply this method, we proceed as follows. To the right of each row of 
the initial matrix, we write down the sum of the entries in that row. 


rı 1 1 2|3\ 7 (=1+1+2+3) 
ro 2 2 3/5| 12 (=2+2+3+5) 
r3 1-1 0ļ|5/ 5 (=1-1+5) 


From then on, when performing elementary row operations, we treat this 
‘check column’ of numbers as if it were an extra column of the matrix, and 
perform the row operations on it. So the first step of the calculation in the 
solution to Worked Exercise C8 above would look as follows. 


1 1 2 3 7 
r3>r—-2r, [0 O -1|/-1] -2 (=12-2x/7) 
r3 > 3 — Ti 0 -2 -2 2 —2 (=5-7) 
At each step in the calculation, each entry in this extra column should still 


be the sum of the entries in the corresponding row. If this is not the case, 
then an error has been made. 
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2.3 Solving linear equations systematically 


We now describe a systematic method for solving a system of linear 
equations by Gauss—Jordan elimination. The method involves performing 
elementary row operations on the augmented matrix of the system. In fact 
you have already seen this method in action, in Worked Exercise C8. Here 
we detail the sequence of steps involved, setting out a general strategy. 


The strategy involves writing down the augmented matrix of the system of 
equations and then performing a sequence of elementary row operations 
that reduces it to a simpler form called row-reduced form. The system of 
equations corresponding to this row-reduced matrix has the same solution 
set as the original system but with the new system it is easy to work out 
what the solution set is. The process of reducing the matrix to 
row-reduced form is referred to as row-reduction. We start by describing 
what a row-reduced matrix looks like. 


Row-reduced matrices 


Here is an example of a row-reduced matrix. 


O (GE O Rooms 0 0 Ri 
0 0 Oj1 3 24 0 O 
0000 0 O/;1 0 
0000 0 0 0/1 
0000 0 0 0 0 0 


The entries of a row-reduced matrix have a staircase form which we have 
emphasised with a black line. All the entries below the staircase must be 0; 
the left-most entry on each line above the staircase must be a 1 and all the 
other entries in that column must be 0. The other entries above the 
staircase can be any numbers. 


The general form of a row-reduced matrix is illustrated below, where the 
entries not in a column containing a leading 1 are indicated with asterisks, 
and the fact that all the entries below the staircase are zero is indicated by 
the large zero. 


We can describe a row-reduced matrix more precisely by specifying that it 


must satisfy certain properties as in the definition below. 


Definition 


A row-reduced matrix is a matrix satisfying the following four 


properties. 


1. Any zero rows are at the bottom of the matrix. 


. Each non-zero row has a leading 1. 


2 
3. Each leading 1 is to the right of the leading 1 in the row above. 
4 


. Each leading 1 is the only non-zero entry in its column. 


Property 3 gives a row-reduced matrix its staircase form, and property 4 
ensures that the entries above and below a leading 1 are all 0. 


Here are some more examples of row-reduced matrices: 


104 70230 
014-8 0 20 1 
000 01 8 Of, |0 
000 00 01 0 
000 00 00 


However, none of the following matrices are row-reduced: 


1 0 
ee 01 01 
00 O], 
Ta 1 0 0 0 
0 0 


The first matrix is not row-reduced as it has neither property 1 nor 


3 
2 
0 
0 


O = © 


5 
0 
1 
0 


1 


0 
4 
0 


i 


oo 02 2 © 
OOS SO Oi 


0 


=. OO 


DO oo © — © 


ooordweo 


ooo oF WwW 


property 2. The second is not row-reduced as it does not have property 3; 


the third does not have property 4. 


Exercise C10 


Which of the following are row-reduced matrices? 


0 1 7 1 0 0 
(a) {1 0 2 (b) | 0 
0 0 0 0 


O IF oO 


0 1 
0 0 


(c) 


OOO G 
O QO O l 


ooro 


oro o 


=N NN 
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Finding solutions from row-reduced form 


Suppose we have been given a system of linear equations, and that we have 
written down its augmented matrix and performed a sequence of 
elementary row operations to reduce it to row-reduced form. We will 
describe these operations in detail shortly, but first we will consider how to 
find all the solutions from the row-reduced form. 


Unique solution 


Consider for example this row-reduced augmented matrix: 


1 0 0| 8 
0 1 0| 3 
0 0 1|—1 


Suppose the unknowns are 71, £2 and x3. Then the system of equations 
corresponding to this matrix is as follows. 
T1 =8 
T2 =3 
z3 = —1 
This system is already in solved form, and we can immediately write down 
the unique solution: 


zı = 8, T2 = 3, z3 = —1. 


Unique solution 


Whenever the original system of equations has a unique solution it 
can be written down directly from the row-reduced matrix. 


No solution 


Now consider this row-reduced augmented matrix: 


1 —6 0/0 
0 0 1/0 
0 0 0}1 
We write down the system of equations corresponding to the matrix. 
w = 6x2 = 0 
T3 = 0 
0=1 


This time we find that one of the equations is 0 = 1. This equation cannot 
hold, so it follows that the system of equations has no solutions; that is, 
the equations are inconsistent. 


No solution 


Whenever the original system of equations is inconsistent, 
row-reducing the augmented matrix yields a system that includes the 
equation 0 = 1. 


Infinitely many solutions 


Now consider this row-reduced augmented matrix: 


10 6/7 
0 1 -—4/2)° 


We can write down the system of equations corresponding to this 
row-reduced matrix, but this time the system does not immediately give us 
a solution nor does it include the equation 0 = 1. 


T1 + 6x3 = 7 
tq — 4x3 = 2 


In this case we rearrange each equation so that everything except the first 
term on the left is moved over to the right-hand side. The effect of this is 
to express each leading unknown, that is, each unknown that 
corresponds to a column containing a leading 1, in terms of the other 
unknowns, the non-leading unknowns. Here, x; and x2 are leading 
unknowns and 3 is the only non-leading unknown. 


21 = 7 — 6x3 
£2 = 2 + 4x3 


Having expressed the two leading unknowns, xı and x2, in terms of the 
non-leading unknown x3 we can then choose any value we like for x3 and 
the equations give us the corresponding values of x; and x2. So the system 
has infinitely many solutions — one for each choice of value of «3. If we set 
x3 = k (k € R), say, and substitute this into the expressions for xı and 22, 
then we have all the unknowns expressed in terms of the parameter k. The 
general solution of the system is therefore: 

Ly = 7—6k 

tq = 2 + 4k 

w=k (k = R). 


Infinitely many solutions 


Whenever the original system of equations has infinitely many 
solutions, the general solution can be determined by setting the 
non-leading unknowns equal to parameters and expressing all the 
unknowns in terms of these parameters. 


As we noted in Subsection 1.2, a system of linear equations must have one 
of these three possibilities: a unique solution, no solution, or infinitely 
many solutions. 
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Worked Exercise C9 


Solve the system corresponding to the following row-reduced augmented 
matrix. Assume that the unknowns are £1, £2, £3, £4, £5. 


10 20 5j 4 


0 1 —3 0 -1 2 

0 0 0 I 3l -7 

0 O 0 O 0 0 
Solution 


@. We write down the system of equations, ignoring the equation 
corresponding to the bottom row of the matrix since it is 
just 0 = 0. # 


The augmented matrix corresponds to the system 


Ly + 2x3 + 5x5 = 4 
£2 — 3x3 = y =? 
£4 + 3x45 = —7. 

®. The system does not immediately give us a solution, and so there 
is not a unique solution. Furthermore, there is no equation 0 = 1 and 
so the system is not inconsistent. Therefore it must be a system with 
infinitely many solutions. We express each leading unknown, 71, £2 
and 24, in terms of the non-leading unknowns, x3 and z5. © 


This system is equivalent to 

t= 4 — 223 — 545 

ma = 2 sb Sieg sb a 

£4 = —7— 325. 
@. We can choose any values for x3 and x5, and the equations will 
give us the corresponding values of 71, x2 and x4. So the system does 
have infinitely many solutions, one for each choice of values for x3 and 
x5. To obtain the general solution of the system, we set x3 and z5 
equal to parameters. .& 
Setting x3 = k and z5 = l, (k,l € R), we obtain the general solution 

Ly = 4 — Dig = 51 


z2 =24+3k+1 
BSk 
z4 = —7— 3l 


zrs=1 (k,lE€R). 


Exercise C11 


Solve the system corresponding to each of the following row-reduced 
augmented matrices. 


(a) Assume that the unknowns are z1, £2. 


(|) 


(b) Assume that the unknowns are 21, £2, £3. 


WIN w= 


1 0 6/0 
0 1 7/0 
0 0 0; 1 


(c) Assume that the unknowns are 21, £2, £3, £4, Xs. 


0 0 1-3 0| 8 
000 0 1) 11 
0 00 0 0} O 


(d) Assume that the unknowns are 71, £2, £3, £4. 


1 0 0 140 
0 1 0 4)3 
0 0 1 00 


Row-reduction strategy 


You have seen that, once the augmented matrix of a system of linear 
equations is reduced to row-reduced form, all the solutions of the system 
can easily be determined. You will now see that there is a systematic 
strategy for row-reducing any matrix using elementary row operations. 


The idea of the strategy is to take each row of the matrix in turn as the 
current row, starting with the first. With row 1 as the current row, we 
carry out four steps, then with row 2 as the current row we carry out the 
same four steps, and so on. In outline the steps are as follows. In step 1 we 
identify the column for the current row’s leading 1; in steps 2 and 3 we 
create a leading 1 in the current row. Finally in step 4 we make each entry 
above and below the leading 1 into a 0. 
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Strategy Cl 


To row-reduce a matrix using elementary row operations, carry out 
the following four steps, first with row 1 as the current row, then with 
row 2 as the current row, and so on, until 


e either every row has been the current row, 
e or step 1 is not possible. 


1. Select the first column from the left that has at least one non-zero 
entry in or below the current row. 


2. If the current row has a 0 in the selected column, interchange it 
with a row below that has a non-zero entry in that column. 


3. If the entry in the current row and the selected column is c, 
multiply the current row by 1/c to create a leading 1. 


4. Add suitable multiples of the current row to the other rows to 
make each entry above and below the leading 1 into a 0. 


The strategy is illustrated in the following worked exercise, where the 
selected rows and columns of the matrix are highlighted by shading. 


You do not need to include this level of detail in your solutions, or the 
shading, just the row operations and current matrix. It is always a good 
idea to include the check column to try to pick up any errors in arithmetic! 


Worked Exercise C10 


Use Strategy C1 to row-reduce the following matrix. 


24 -2 2 4 
36 -3 6 5 
2 1 -ll 2 6 
—1 1 10 -7 -2 


2 Row-reduction 


®. Steps 2 and 3 create a leading 1 in the current row. 


The current row does not have a 0 in the column selected: it has a 2, 
and so step 2 does not apply. In step 3 we multiply the current row by 
the reciprocal of 2; that is, by $. 


In fact, when using this strategy to row-reduce a matrix there is often 
nothing to be done in step 2. ® 


rı > jr | = á 1 2 5 
sE -3 6 5 | 17 
21-11 2 6] 0 
-1 1 10 -7 -2 1 


®@. Step 4 makes each entry above and below the current leading 1 
into a 0 by adding suitable multiples of the current row to the other 


rows. & 
1 2 —1 1 2 5 
rə > ro — 3r1 0 0 0 a =l 2 
r3 > r3 — 2rı 0 -3 -9 0 2 —10 
r4 >r4+ri 0 3 9 —6 0 6 


®. None of these row operations changes a row that is then used by 
another of these row operations, so they can be carried out in one go; 
in fact, this will always be the case for the row operations required in 
step 4. 


Row 2 is the current row. 


Step 1 identifies the column for the current row’s leading 1: 
column 2. ® 


rı 1 ee —1 Llo 2 5 
r2 0 © a =l 2 
r3 0 9 0 2 =10 
r4 a 9 6 0 6 


®. Steps 2 and 3 create a leading 1 in the current row. 


The current row does have a 0 in the column selected, so in step 2 we 
interchange it with a row below that has a non-zero entry in that 
column. We choose to interchange it with row 4, although it does not 
matter which row of these we use. ® 


1 ye — 1 1 2 5 
ror, 0 Pay 2 =6 0 6 
Oem 9 0 2 = 10 
Om 0 3 -1 2 
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®. The current row has a 3 in the column selected, so in step 3 we 
multiply the current row by the reciprocal of 3; that is, z. A 


ig o 1 2 5 
r2 > $r 11 o o o 2 
0 -3 -9 0 2 | -10 
Of 0 3-1 2 


@. Step 4 makes each entry above and below the current leading 1 
into a 0 by adding suitable multiples of the current row to the other 


rows. ® 
rı > rı — 2r2 1 fom —7 5 2 1 
Om 1 3-2 0 2 
r3 > r3 + 3r2 o Ro 0 —6 2 —4 
opg 0O 3 =!1 2 


@. Row 3 is the current row. 


Step 1 identifies the column for the current row’s leading 1: 
column 4, .® 


rı 1 0 —7 Wi 2 il 
r2 0 1 34 l 2 
r3 © 0 Omm 2 —4 
r4 0 0 o —1 2 


®. Steps 2 and 3 create a leading 1 in the current row. 


Here, step 2 does not apply, and in step 3 we multiply the current row 


by the reciprocal of —6; that is, —4. @ 


1 0 -7 Ea 2\ 1 
o1 3 @A oj- 
r3 > —ġr3 00 0 1-3 | 2 
00 of -1/ 2 


@. Step 4 makes each entry above and below the current leading 1 
into a 0 by adding suitable multiples of the current row to the other 


rows. .& 
rı > rı — org 1 0 -7 0 H -7 
r2 > r2 + 2r3 ogi 0-2] 2 
1 2 
0 0 1 => 3 
Ea fa 3k 0 0 o o0 0 
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If the strategy has been carried out correctly, then the matrix will be in 
row-reduced form when we stop, as was the case in the worked exercise 
above. 


In general, when applying the strategy we stop either after every row has 
been the current row and had the four steps carried out, or when we find 
that step 1 is not possible, which happens when there are one or more zero 
rows at the bottom of the matrix. 


Exercise C12 


Use Strategy C1 to row-reduce the following matrices. 


1 5 1 4 5 -!1 
(a) 1 5 3 12 11 3 
3 15 -1 -4 3 -6 
—2 -10 1 2 -7 6 


0 -8 8 -14 


at fj =f 26 
(b) -1 8 -12 8 
2 8 0 24 
1 4 0 14 


Modifying the strategy 


The strategy for row-reducing a matrix works for any matrix and can 
easily be programmed on a computer. But sometimes when carrying it out 
by hand we can spot places where carrying out a different row operation 
will make the calculations easier. Suppose we are working with the matrix 
below and that we have completed the four steps with row 1 as the current 
row. Row 2 becomes the current row and step 1 identifies column 2 for the 
current row’s leading 1. 


rı 1 Rog 1 2 T 
TQ 0 4 | D Y 16 
r3 0349 16 
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Since the entry is not 0 there is nothing to be done in step 2. In step 3 we 
are now Officially supposed to multiply the current row by - in order to 
create a leading 1, but this will create inconvenient fractions as other 
entries in row 2. We can, however, spot a different row operation that will 
also create a leading 1 in the current row, but avoids creating fractions, 
namely re > ro — r3, since subtracting the 3 from the 4 will create a 
leading 1. So we perform this alternative row operation as an unofficial 
version of step 3 and this gives us the matrix below. 


1 Roe 1 2 7 
rg > rg —13 On 1 Bie 0 
0\3 4 9 16 
We now carry out step 4 as normal: 
Lie S a Bro 1 0 -2 8 7 
of 1 1 —2 0 
r3 > r3 — 3r2 0 0 1 15 16 


We then carry on with the third row as the current row. 


In general, if you are trying to reduce a matrix to row-reduced form, you 
can use any elementary row operation. Note that even so it can sometimes 
be impossible to avoid fractions. 


Until you are very familiar with row-reducing matrices, it is sensible to 
follow the systematic strategy very closely, considering modifications only 
at step 3. 


When modifying the strategy and trying to identify an alternative row 
operation, it is important not to use rows above the current row, as the 
following exercise illustrates. 


Exercise C13 


Consider the following matrix where row 2 is the current row. 


rı 1 3 1 2 T 
r2 0 4 5 7] 16 
r3 0 3 4 9/ 16 


Carry out the following row operation and explain why it is not an 
appropriate alternative operation for step 3. 


Yo ->s Ti 


When trying to choose an alternative row operation, rows below the 
current row can be used because the zeros at the beginning of these rows 
prevent them destroying the progress made so far. 


Uniqueness 


We have seen that there can be different ways to row-reduce a matrix. 
Whichever way you choose, you will always get the same answer. This is a 
consequence of the following theorem, which we state without proof. 


Theorem C1 


Every matrix has a unique row-reduced form. 


Putting it all together 


We now have all the techniques necessary for using Gauss—Jordan 
elimination to solve a system of linear equations using augmented matrices; 
we just need to put them all together as set out in the following strategy. 


Strategy C2 


To use Gauss—Jordan elimination to solve a given system of linear 
equations: 


1. form the augmented matrix 
2. row-reduce the augmented matrix to obtain its row-reduced form 


3. solve the simplified system of linear equations. 


Worked Exercise C11 


Use Strategy C2 to solve the following system of linear equations. 
3x + 5y — 12z=4 


t+ y =2 
2r + 3y — 4z=5 
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@. We now carry on as usual, following the strategy. ©& 


il il 0 2 4 
fo > Tg — 3r) 0 2 -—12)-2]) -12 
r3 > r3 — 2rı omi —4 1 —2 

i 1 0 2 4 
r2 > ro 0 1 -6|-1]} —6 

0 1 —4 1/ —2 
ie Sp Le f il @ 6 3 10 

QO t =O] =|) =o 
Vay ze 1a — Te) 0) 0 2 2 4 

1 0 6 3 10 

o =6| =|) EG 
r3 > 573 0 S| i/y 2 
SSR S 6r3 i @ @ | =3 —2 
to tors O Lt © 5 6 

DOi 1 2 


®@. This matrix is in row-reduced form. © 
The corresponding system of equations is 


a ==. 
y = 5, 
eels 


Thus the solution is x = —3, y=5, z= 1. 


Exercise C14 


Use Strategy C2 to solve the following system of equations. 
£1 — 4xq — 403 + 844 + 625 = 2 
221 — 5x2 — 643 + 6%4 + 925 = 3 
221 + 4x9 + 9x4 + 275 = 0 
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3 Matrix operations 


In this section you will revise matrices and matrix operations such as 
matrix addition and matrix multiplication. You will also meet a useful 
operation called transposition. 


3.1 Matrix arithmetic 


Recall that a matrix with m rows and n columns is an m x n matrix. An 
n x n matrix is called a square matrix. 


In general, we write A or (a;;) to denote a matrix: 


a11 a12 Qin 
a21 a22 EE a2n 

A= ‘ i . . = (aij): 
Ami Am2 ‘** Amn 


We call the entry in the ith row and jth column of a matrix A the 

(i, j)-entry, and often denote it by a;j. Although matrices are usually 
distinguished in print by the use of bold typeface, when you handwrite 
them you do not need to underline them, unlike letters that represent 
vectors. 


Matrices are closely related to vectors represented in component form. In 
Unit Al you performed vector arithmetic on vectors in both R? and R, 
writing a vector in component form as a row vector. Such a row vector 
can be regarded, respectively, as a 1 x 2 matrix or a 1 x 3 matrix with real 
entries; the only difference is the lack of commas in the matrix 
representation. For example, consider the following 1 x 3 matrix and the 
corresponding row vector in R?: 


(1 2 3) and (1,2,3). 


A column vector is a vector with the components written vertically; such 
a vector in R? or R can be regarded as a matrix with real entries that has 
just a single column. For example, the following represents both a column 
vector in R? and the corresponding 3 x 1 matrix: 


1 
2 
3 


It should be clear from the context whether this object is a column vector, 
with a geometrical interpretation in RÌ, or a matrix with real entries. 


A matrix may have any size, m x n for any natural numbers m and n, 
although we usually write a 1 x 1 matrix without the brackets and identify 
it with its single entry. 
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In this way, matrices can be regarded as a generalisation of vectors with 
equality, the zero matrix and the operations of addition and scalar 
multiplication defined similarly. Whereas for vectors we defined these in 
terms of the components, for matrices we define them in terms of the 
entries. The details are given in the box below. 


Matrix arithmetic 


Equality Two m x n matrices A and B are equal if all their 
corresponding entries agree. We write A = B. 


Zero matrix The m x n zero matrix Om,n is the m x n matrix in 
which all entries are 0. It is denoted by O when it is clear from 
the context which size is intended. 


Addition The sum of two m x n matrices A = (a;;) and B = (b;;) 
is the m x n matrix A + B = (aij + bij) obtained by adding the 
corresponding entries: 


Chae Giese =° Cin T Ow 

a21 +b21 a22 +b22 +++ = Gan + ban 
A+ B= . ; 

Ami + Daal Am2 T bm2 soo (hey SP Orun 


Addition of matrices of different sizes is not defined. 
Negatives The negative of an m x n matrix A = (a;;) is the 
m x n matrix obtained by taking the negatives of its entries: 
=A = (—aj;). 
Subtraction The difference of two m x n matrices A = (aij) and 
B = (6;;) is the m x n matrix A — B = (C — O) obtained by 
subtracting the corresponding entries: 


Cie Ole ba e Cip = Dip 

a21 — b21 agg — b22 +++ ~— Aan — bon 
ABE : : 

Ami — bmi Am2 — bm2 oao Crag Dear 


Subtraction of matrices of different sizes is not defined. 


Scalar multiplication The scalar multiple of an m x n matrix 
A = (aij) by a real number k is the m x n matrix obtained by 
multiplying each entry in turn by k. 


kay kay Soi kain 
kag, kaz + kazn 

Aa ee leas) 
[aie (Ailes, 9° [Rater 
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3 Matrix operations 


For example, consider the matrices below. The first pair are not equal 
because a pair of corresponding entries differ, and the second pair are not 
equal as they have different sizes: 


1 
123 121 i it 4 
eee, ane Gi a4() 


The following are all examples of zero matrices: 


00 --- 0 
i 0000 0 0 0 
op (0 9 0), {0 0 0 0f and ey, 18 
000 0 2... 

0 0 --- 0 


The next worked exercise illustrates matrix addition. In the subsequent 
exercises you are asked to evaluate the results of various matrix operations. 


Worked Exercise C12 


Evaluate the following matrix sums, where possible. 
1 2 


OEE) orl 


Solution 


® G a)+(o a0 3) 


(b) This sum is undefined since the matrices are of different sizes. 


Exercise C15 


Evaluate the following matrix sums, where possible. 


+G i) OG +a wa) 
1 
1 


1 2 2 2 0 6 -2 1 2 9 
(c) [1 O} + 3 1 (a) |1 8 2]/+ ]1 0 4 
4 1 —2 4 5 0 3 4 3 —4 1 
Exercise C16 
Evaluate the following matrix differences, where possible. 
(a) € J 7 : (b) G 8 ‘) z (i 10 3) 
2 7 15 12 7 2 -1 4 9 21 
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Exercise C17 


Let 
5 —3 2 1 
A= 2 3 and B={-2 -7 
—1 0 3 5 


Evaluate the following. 
(a) 4A (b) 4B (c) 4A +4B (d) 4(A +B) 


In Exercise C15 you should have found that parts (a) and (b) gave the 
same answer; this is because matrix addition is commutative. In fact, 
matrix addition has the same properties as the additive properties of the 
real numbers, R, given in Unit A2 Number systems. Before listing these 
properties, we need the following notation: 


Mm,n denotes the set of all m x n matrices with real entries. 


We can now talk about arithmetic in Mm» and the properties it satisfies. 


Addition in Mm,n 

A1 Closure For all A,B € My n, 
A+ Be Mn: 

A2 Associativity For all A,B,C € Mm n, 
(A+B)+C=A+(B+C). 

A3 Additive identity For all A E€ My» and 0 E€ Mmn, 
A+0=A=0+A. 


A4 Additive inverses For each A € Mm,n, there is a 
matrix —A E€ Mm,n such that 


A+(-A)=0=-A+A. 
A5 Commutativity For all A,B € Minn, 
A+B=B+A. 


The matrix 0 is known as the additive identity in Mm,n, and the 
matrix —A in property A4 is known as the additive inverse of A. 


These properties follow from the definition of matrix addition and the 
corresponding properties of the reals. The next worked exercise proves the 
closure property (A1) and the commutative property (A5); you are asked 
to prove the remaining properties in the following exercise. 


Worked Exercise C13 


By using the corresponding properties for the reals, prove that the 
following properties hold for Mm,n under addition. 


(a) The closure property (A1): A+B € Mm,n. 
(b) The commutative property (A5): A+B=B+A. 


Exercise C18 


By using the corresponding properties for the reals, prove that the 
following properties hold for Mm,n under addition. 


(a) The associative property (A2): A+ (B + C) = (A +B) +C. 
(b) The identity property (A3): A+0=A=0+A. 
(c) The inverses property (A4): A + (—-A)=0=-A +A. 


Recall from Subsection 3.1 of Unit B1 Symmetry and groups that a set 
with a binary operation is a group if the following four axioms hold: 


G1 (closure), G2 (associativity), G3 (identity) and G4 (inverses). 


The first four properties (A1-A4) of matrix addition show that the set of 
all m x n matrices with real entries satisfies these four properties; that is, 
(Mm,n, +) is a group with additive identity the zero matrix 0, and —A the 
additive inverse of A. The final property (A5) shows that it is in fact an 
abelian group. 
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Although this unit concentrates on Mm», the set of matrices with real 
entries, some other sets of m x n matrices also form a group under 
addition. For example, the set of m x n matrices with entries in Z, and 
those with entries in C, both form a group under addition. However, the 
set of m x n matrices with entries in N does not form a group under 
addition, since this set of matrices contains neither the zero matrix 0, nor 
the additive inverse —A of a matrix A in the set. 


Finally in this subsection we return to scalar multiplication of matrices. 
Recall, from Unit A2, that the reals satisfy a distributive property (D1) 
combining addition and multiplication: 


ax (b+c)=(axb)+(axc), forall a,b,c ER. 


It turns out that the corresponding property holds for addition and scalar 
multiplication of matrices; you saw one example of this in Exercise C17(c) 
and (d) where 4(A + B) and 4A + 4B were equal. 


Combining addition and scalar multiplication in Mm,n 
D1 Distributivity For all A,B € Mm,n and k € R, 


k(A +B) = kA + KB. 


You are asked to prove that this property holds in the next exercise. 


Exercise C19 


By using the corresponding property for the reals, prove that the 
distributive property (D1) holds for Mm,n: 


k(A +B) = kA + kB. 


3.2 Matrix multiplication 


In the previous subsection you saw that matrix addition and scalar 
multiplication can be defined in terms of matrix entries, much like the 
corresponding operations for vectors. In this subsection you will revise 
matrix multiplication, which can also be defined in terms of matrix entries, 
much like the corresponding operation for vectors — the scalar product. 


Recall from Unit Al that the scalar product of two vectors a = (a1, a2, a3) 
and b = (bı, ba, b3) in R3 is 

a- b = abı + a2b2 + a3b3. 
Matrix multiplication is a generalisation of this idea. 


To form the product of two matrices A and B, we combine the rows of A 
with the columns of B. The (i, j)-entry of the product AB is obtained by 
multiplying each entry in the ith row of A by the corresponding entry in 
the jth column of B and adding the results. 


3 Matrix operations 


This product is only possible if the number of columns of A is equal to the 
number of rows of B. 


For example, let 


1 2 3 
A=(j : and B={4 5 6 
8 9 


The number of columns of A is equal to the number of rows of B, so it is 
possible to find the product AB. 


To obtain the (1,1)-entry of the product AB we combine the first row of 
A with the first column of B: 


(1x1) +(2x4)+(3x 7) =14+8+421 = 30. 


Next, to obtain the (1, 2)-entry of the product AB, we combine the first 
row of A with the second column of B: 


(1 x 2) + (2 x 5) + (3 x 8) = 2 + 10 + 24 = 36. 


Then to obtain the (1,3)-entry of the product AB, we combine the first 
row of A with the third column of B: 


(1 x 3) + (2 x 6) + (3 x 9) = 3 + 12 +27 = 42. 


To obtain the entries in the second row of the product AB, we combine 
the second row of A with each of the columns of B in turn. 


In the end we obtain 2 x 3 entries in the product AB; this matrix has 2 
rows and 3 columns as follows. 


12 3 tse) p30 36 42 
456 ~ \66 81 96 


roe 


7 8 9 @ = ee o 
. š ë . 7 E e e e 
One way to remember how to multiply matrices A and B is to picture 
running along the rows of A and then diving down the columns of B. The °°? 
example pictured in Figure 13 gives the (1, 2)-entry. Figure 13 Running along and 
diving in 


Definition 

The product of an m x n matrix A with an n x p matrix B is the 
m x p matrix AB whose (i, j)-entry is obtained by multiplying each 
entry in the ith row of A by the corresponding entry in the jth 
column of B and adding the results. 


In symbols, if C = AB, then 
Cig = Cbig + Q:2b25 +--+ + Qindn;- 


The product AB is not defined when the number of columns of the 
matrix A is not equal to the number of rows of the matrix B. 
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Schematically, this can be shown as follows. 


<—N—> js ~—p—> 


row i column j (i, 7)-entry 


Worked Exercise C14 


Evaluate (where possible) the matrix products AB, where: 


(a) A=(3 7 ga B=(i < ) 


Solution 


(a) ®. The matrix A has 2 columns and the matrix B has 2 rows, so 
the product AB can be formed. ® 


The product of a 2 x 2 matrix with a 2 x 3 one is a 2 x 3 matrix. 


®. When evaluating a product of matrices, it is advisable to find 
the entries systematically, either row by row, or column by 
column. Here, we find the entries row by row. 


To find the (1, 1)-entry of AB, we multiply each entry in the first 
row of A by the corresponding entry in the first column of B: 


(2x 3)+(1x1)=7. 


Next, to find the (1, 2)-entry of AB, we apply the same 
procedure to the first row of A and the second column of B: 


Cx?) ih 


Next, to find the (1,3)-entry of AB, we apply the same 
procedure to the first row of A and the third column of B: 


(2x 0)+(1x 4) =4. 
Together, these give the first row of AB: © 


T -3 4 
( x * Ok ) 
®. We continue by finding the (2,1)-entry of AB then the 
(2, 2)-entry and finally the (2,3)-entry, by applying the same 
procedure to the second row of A with the columns of B in turn. 
This gives the second row of the product AB: .©& 
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Exercise C20 


Evaluate the following matrix products, where possible. 
2 -1 


ob 0) eer) o HEA 


@ G)@ 0-4) ofi 1 


=1 


In the previous subsection you saw that addition on the set Mm,n of m x n 
matrices satisfies the usual properties (Al—A5) for addition. For 
multiplication of matrices things are not so straightforward. To start with, 
if m Æ n then the product of two matrices in the set Mm n is not even 
defined. 


So when we consider properties of matrix multiplication we are only 
interested in products that can be formed. For example, we can say that 
matrix multiplication is associative because, whenever these products can 
be formed, (AB)C = A(BC). You will prove this result in Unit C3. 


In the next exercise you are asked to prove that matrix multiplication is 
not commutative. 


Exercise C21 


(a) Prove that the products AB and BA are the same size if and only 
if A and B are square matrices of the same size. 


(b) Prove that matrix multiplication of square matrices of the same size is 
not commutative by giving a counterexample; that is, find two 2 x 2 
matrices A and B such that AB # BA. 


The fact that matrix multiplication is not commutative means that it is 
important to describe a matrix product carefully. We say that AB is the 
matrix A multiplied on the right by the matrix B, or the matrix B 
multiplied on the left by the matrix A. 


3 Matrix operations 
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You have seen that the distributive property (D1) holds for multiplication 
of a matrix by a scalar. Matrix multiplication is also distributive because, 
whenever these products can be formed, A(B + C) = AB + AC. The proof 
of this is not hard, but it is not very illuminating, so is not given here. 


Diagonal and triangular matrices 


The entries of a square matrix from the top left-hand corner to the bottom 
right-hand corner are the diagonal entries; the diagonal entries form the 
main diagonal of the matrix. In some texts the main diagonal is called 
the leading or principal diagonal. For a square matrix A = (aij) of size 

n x n, the diagonal entries are 


Q11, 422, «++, Ann: 


A matrix that has its only non-zero entries on the main diagonal can be 
useful. 


Definition 


A diagonal matrix is a square matrix each of whose non-diagonal 
entries is zero. 


For example, the following are diagonal matrices: 


3 0 0 
G e and 0 —7 0 
0 0 0 


To see how diagonal matrices multiply, try the following exercise. 


Exercise C22 


1 0 —3 0 2 0 
ht, Bel, 4) SSS 


Evaluate the following products. 
(a) AB (b) BA (c) ABC 


Let 


The product of two diagonal matrices is another diagonal matrix, and the 
ith diagonal entry of the product is the product of the ith diagonal entries 
of the matrices being multiplied. Multiplication of diagonal matrices is 
therefore commutative. 


More generally, positive powers of square matrices are defined as 
expected: 


A? = AA, A? =AAA, 


Therefore, finding powers of diagonal matrices is straightforward and you 
will see how this fact can be used to find powers of other square matrices 
in Unit C4 Eigenvectors. 


A square matrix with each entry below the main diagonal equal to zero is 
called an upper triangular matrix. Similarly, a square matrix with each 
entry above the main diagonal equal to zero is called a lower triangular 
matrix. A square row-reduced matrix is an upper triangular matrix. A 
square matrix that is both upper triangular and lower triangular is 
necessarily a diagonal matrix. 


Exercise C23 


State which of the following matrices are diagonal, upper triangular or 
lower triangular. 


k a 0 0 1 
9 0 1 0 
(a) [0 2 2 (b) (c) [0 1 2 (d) 
0 0 3 (c o) 1 2 3 (; o) 


Identity matrix 


You have seen that there are matrices corresponding to the number 0, 
which is the additive identity in the reals. These matrices are the zero 
matrices Om,n, each of which is the additive identity in Mn. There are 
also matrices corresponding to the number 1, which is the multiplicative 
identity in the reals. These matrices are square matrices called the identity 
matrices, denoted by Ip. The subscript n indicates that the matrix is an 

n x n matrix; however, as with the zero matrix, the identity matrix is 
written simply as I when the size is clear from the context. 


Definition 


The identity matrix I, is the n x n matrix 


I O so5 © © 
0 T css 0 @ 
O O se» i Q 
0 @ es Q i 


Each of the entries is 0 except those on the main diagonal, which are 
all 1. 


For example, the identity matrices Ip, I3 and I4 are 


1 0 0 0 
1 0 Ao 0 1 0 0 
0 1 loo (0010 
000 1 
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If we multiply a 3 x 2 matrix on the left by Iz we obtain 


1 0 0 a b a b 
0 1 0 c d|/= tea 
00 1) \e f e f 


If we multiply the same 3 x 2 matrix on the right by Ip we obtain 


a b a b 
Ao t)=[e 4 


Cc 
0 1 
e f i 
Here, a, b, c, d, e and f are any real numbers. In both cases, the matrix is 
unchanged. 
Theorem C2 


Let A be an m X n matrix. Then 


InA = A = AL. 


You are asked to prove this theorem in the next exercise. 


Exercise C24 


Let A = (aj;) be an m x n matrix. Prove Theorem C2; that is, prove that 
I,,A = A and Alẹ, = A. 


Hint: Notice that the entries in the ith row of Im are all 0 except the entry 
in the ith position, which is 1. 


3.3 Transposition of matrices 


There is a simple operation that we can perform on matrices. This 
operation, called transposition or taking the transpose, entails 
interchanging the rows with the columns of the matrix. Thus the transpose 
of the matrix A, denoted by AT, has the rows of A as its columns, taken 
in the same order. For example, 


o ra /147 IA Aagi 
N 4 5 6] =|2 5 8 and —6 1 ae D 
7 7 3 4 3 6 9 0 4 


Transposition of a square matrix can be thought of as reflecting the matrix 


g in the main diagonal, as illustrated in Figure 14. 


Figure 14 Transposition as 
reflecting in the main diagonal Definition 


The transpose of an m x n matrix A is the n x m matrix AT whose 
(i, j)-entry is the (j, i)-entry of A. 
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Exercise C25 


Write down the transpose of each of the following matrices. 


1 4 2 1 2 
1 0 
(a) | 0 2 (b) [0 3 -$ (c) (10 4 6) (ad) 
—6 10 4 7 0 l ) ( ) 


The identity matrix I is not changed by taking the transpose; that is, 
I” =I. In fact, A? = A for all diagonal matrices; you saw one such 
example in Exercise C25(d). 


The operation of transposition has some other useful properties as you will 
now see. 


The rows of the matrix A form the columns of the matrix AT, and the 
columns of AT form the rows of (AT)T. Therefore the rows of A form the 
rows of (A7)?; that is, these two matrices are equal: 


(AT)T =A. 


Exercise C26 


Let 
1 2 7 8 1 0 
A=1{3 4], B=] 9 10 and g=] a 
5 6 11 12 


(a) Find A’, BT and (A +B)’, and verify that (A +B)? = AT + BT. 


(b) Find CT and (AC)’, and find an equation relating (AC), AT 
and CT. 


The relationships satisfied by the matrices in Exercise C26 hold in general. 


Properties of matrix transposition 

Let A and B be m x n matrices. Then: 

l (A sA 

2. (A+B)? =A 1B, 

Let A be an m x n matrix and B an n x p matrix. Then 
3 (AB) = BAT. 
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Symmetric matrices 


Some square matrices remain unchanged when transposed. These matrices 
are called symmetric matrices, since they are symmetrical about the main 
diagonal. 


Definition 


A square matrix A is symmetric if AT = A. 


Since A? = A for all diagonal matrices, all diagonal matrices are 
symmetric. Here are other examples of symmetric matrices: 


123 4 
Te ri 256 7 —5 2 
113) Mis [3 6 8 9f’ 2 3J 
4 7 9 10 


3.4 Matrix form of a system of linear 
equations 


In this subsection you will see how a system of linear equations can be 
expressed in matrix form as a product of matrices. This contrasts with the 
augmented matrices you met in Subsection 2.1, which are an abbreviated 
notation for the system and involve no products of matrices. 


Consider the following system of linear equations. 


r1 + 2x2 + 4z3 = 6 
Tit £3 > 1 
xı + 3x2 + 5x3 = 10 


We can write this system as a matrix equation: 


£1 + 2x9 + 4x3 6 
z2 + z3 | = 1 
zı + 3x2 + 523 10 


Now the 3 x 1 matrix on the left can be expressed as the product of two 
matrices, namely the 3 x 3 matrix of the coefficients and the 3 x 1 matrix 
of the unknowns: 


zı + 2% + 4x3 12 4 Ly 
t+ 73/=]0 1 1 T2 
xı + 3x2 + 523 1 3 5 T3 


Thus we have the matrix equation 


1 2 4 LY 6 
0 1 1 T2 z= 1 
1 35 T3 10 


Similarly, we can express any system of linear equations 


a11£1 + ai2£2 +: + ainTn = b1, 
a211 + a22%£2 +++: + A2mTn = bo, 


Am1X1 + Am2%2 + +: + Amnn = bm, 


as a matrix product. Let the matrix of coefficients be A, the coefficient 
matrix of the system, that is, 


a11 a12 Qin 

a21 Q22 a2n 
A= À 

Ami Am2 `° Amn 


Let the matrix of unknowns be x, and let the matrix of constant terms 
be b, so 


Ti by 
T2 bo 
x= and b=] . 


The system can then be expressed in matrix form as 


Ax = b, 
or in full as 
ai Q2 **" Gin £1 by 
a2 Q2 > Gan T2 b2 
Am1 Am2 °*** Amn Tn bm 


Writing a system of linear equations in matrix form will allow us to 
manipulate the system using matrix multiplication. 


4 Matrix inverses 
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4 Matrix inverses 


In this section you will investigate the multiplicative properties of square 
matrices and the existence of multiplicative inverses. 


4.1 Matrix inverses 


In Section 3 you saw that matrix addition in Mm, satisfies the usual 
properties (A1l—A5) for addition, but things are not so straightforward for 
multiplication of matrices. 


If we restrict our attention to the set Mn,n of square matrices with real 
entries, then products of these matrices can always be formed, and so the 
following properties hold. 


Multiplication in Mn,n 

M1 Closure For all A,B € Mn», 
AB € Mnn- 

M2 Associativity For all A, B,C € Mn», 
(AB)C = A(BC). 

M3 Multiplicative identity For all A € My», 
AI, = A=1,A. 


The closure property (M1) follows from the definition of matrix 
multiplication and the associative property (M2) will be proved in 

Unit C3. The multiplicative identity property (M3) holds by Theorem C2 
and we say that I, is the multiplicative identity in Mn. 


You saw that matrix multiplication is not commutative, even for square 
matrices, and so the commutative property (M5) does not hold for matrix 
multiplication in M,,,. The distributive property (D1) does hold for 
matrix addition and matrix multiplication in Mn,n; that is, matrix 
multiplication is distributive over matrix addition. However, because 
matrix multiplication is not commutative we have to consider multiplying 
on the right and left separately. 


Combining addition and multiplication in M,,,, 
D1 Distributivity For all A,B,C € Mnn, 


A(B+C)=AB+AC, 
and 


(A +B)C = AC + BC. 


You may have noticed that one other property is missing from the list of 


multiplicative properties, namely the multiplicative inverses property (M4). 


Recall, from Exercise C21(a), that the products AB and BA are the same 
size if and only if A and B are square matrices of the same size. 


We say that B is a multiplicative inverse of A in Mn,n if A,B € Mn,n 
and AB = I, = BA. In fact, because the additive inverse of a matrix is 
usually called the negative of the matrix, the multiplicative inverse is 
usually called the inverse of a matrix, where the context is clear. 


We now investigate the existence of multiplicative inverses. 


Many square matrices do have multiplicative inverses, for example, 


3 —-1\ . š f 2 1 
_5 9g) 18an inverse of |, , 


since 


and 
3 —1 2 1\_ /10 
—5 2 5 3) \o 1 
Similarly, 
—1 —5 -2 1 3 —1 
0 2 1 | is an inverse of | —2 —5 1 
—2 1 1 4 11 -2 
since 
1 3 1 1 5 2 1 0 
—2 —5 1 0 2 1]/={]0 1 0 
4 11 -2 —2 1 1 0 1 
and 
—1 —5 -2 1 3-1 1 0 0 
0 2 1 —2 —5 1]/=/]0 1 0 
—2 1 1 4 11 -2 0 0 1 


Just as a real number has at most one multiplicative inverse, or reciprocal, 
a square matrix has at most one inverse, as we now prove. 


Theorem C3 


If a square matrix has an inverse, then this inverse is unique. 
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Proof Let A be asquare matrix, and suppose that B and C are both 
inverses of A. Then AB = I = BA and AC = I = CA. 


®. We consider the product CAB = C(AB) = (CA)B. # 

Multiplying the equation AB = I on the left by C, we have 
C(AB) = CI=C, 

while multiplying the equation CA = I on the right by B gives 
(CA)B = IB =B. 


Since matrix multiplication is associative, it follows that B = C. | 


Certainly a square zero matrix has no inverse (just as the real number 0 
has no reciprocal), since if 0 is a square zero matrix, then any product of 0 
and another matrix is a zero matrix, and so there is no matrix B such that 
OB =I. However, it is natural to ask whether or not every non-zero 
square matrix has an inverse. The next exercise demonstrates that the 
answer to this question is no: it gives an example of a non-zero square 
matrix with no inverse. 


Exercise C27 


1 -1 
Let A = (i a 
Prove that there is no matrix B = ( 


) such that AB = I. 


In fact, there are many non-zero square matrices with no inverse. The next 
theorem gives an infinite class of such matrices. 


Theorem C4 


A square matrix with a zero row has no inverse. 


Proof Let A be a square matrix, one of whose rows, say row i, is a zero 
row. Then if B is any matrix of the same size as A, the (i, i)-entry of AB 
is 0, since it is obtained by multiplying each entry in row i of A (a zero 
row) by the corresponding entry in column i of B. But the (i, i)-entry of I 
is 1, which shows that there is no matrix B such that AB =I. Hence A 
has no inverse. | 


Definition 


A square matrix that has an inverse is called invertible. 


An invertible matrix is necessarily a square matrix in order for the 
products AB and BA to exist and be equal. 


Since we know by Theorem C3 that if a matrix has an inverse, then this 
inverse is unique, we denote the unique inverse of an invertible matrix A 
by A7!. Thus, for any invertible matrix A, 


AA“ =I = AA. 


Both A and AW! are square matrices of the same size. It follows from 
these equations that if A is an invertible matrix, then A! is also 
invertible, with inverse A; that is, 


(At = A. 
In other words, the matrices A and AT! are inverses of each other. 


The next worked exercise and the following exercises give some other 
useful facts about inverses of matrices. 


Worked Exercise C15 


Let A be an invertible matrix. Prove that A” is invertible, and that 
{Ar} = (AFI 


Exercise C28 


Prove that the identity matrix I is invertible, and that I~! = I. 


Exercise C29 


Let A and B be invertible matrices of the same size. Prove that AB is 
invertible, and that (AB)~' = B-'A7!?. 
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Notice the reversal of the order of the matrices in the identity 
(AB) '=B AT. 


This result of Exercise C29 extends to products of any number of matrices; 
it can be proved using this result and mathematical induction. 


Theorem C5 


Let A1, A2,..., Ak be invertible matrices of the same size. Then the 
product A; A»--- Az, is invertible, with 


(Aq Age Ae Ae Ae Ae 


You saw in Subsection 3.1 that (Mm n,+), the set of all m x n matrices 
with real entries, forms a group under addition. The results of 

Exercises C28 and C29, together with the properties M1—M3 for matrix 
multiplication in Mn,n, can be used to show that the set of all invertible 
matrices of a particular size and with real entries forms a group under 
matrix multiplication. The restriction of the set to include only invertible 
matrices is important: without this, the axiom G4 (inverses) clearly fails 
since, for example, the zero matrix has no inverse. 


Theorem C6 


The set of all invertible n x n matrices with real entries forms a group 
under matrix multiplication. 


Proof We check the four group axioms. 


G1 Closure Exercise C29 showed that if A and B are invertible n x n 
matrices then their product AB is invertible. The product AB is an 
n x n matrix, so group axiom G1 (closure) holds for this set. 


G2 Associativity The associative property (M2) holds for matrix 
multiplication in Mn, n, so group axiom G2 (associativity) holds. 


G3 Identity The identity property (M3) holds for matrix multiplication 
in Mn,n, and Exercise C28 shows that I, is in the set of all invertible 
n x n matrices with real entries. Therefore group axiom G3 
(identity) holds. 


G4 Inverses_ The set of all invertible n x n matrices with real entries is 
a subset of My. By definition every matrix in the set of invertible 
matrices has an inverse, and this inverse is itself invertible and 
therefore in the set, so axiom G4 (inverses) holds. 


Hence the set of all invertible n x n matrices with real entries under the 
operation of matrix multiplication satisfies the four group axioms, and so 
is a group. a 
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4.2 Invertibility Theorem 


The following two questions may already have occurred to you as you 
worked through the previous subsection. First, how can we determine 
whether or not a given square matrix is invertible? Second, if we know 
that a matrix is invertible, how can we find its inverse? The next theorem, 
which we will prove in Subsection 4.5, answers both these questions. 


Theorem C7 Invertibility Theorem 
(a) A square matrix is invertible if and only if its row-reduced form 
is I. 


(b) Any sequence of elementary row operations that transforms a 
matrix A to I also transforms I to A™t. 


To illustrate this theorem, consider the matrix 


1 3 
A= G 5) | 
Suppose that we wish to determine whether or not A is invertible and, if it 


is, to find ATİ}. 


Below, on the left, we row-reduce A in the usual way. On the right, we 
perform the same sequence of elementary row operations on the 2 x 2 
identity matrix. 


rı 1 3 rı 1 0 
r2 2 9 r2 0 1 


1 3 1 0 

ro > r2 — 2r1 0 3 to > ro — 2r1 —2 1 

1 3 1 0 

rg— dro 0 1 ro => iro —3 + 
r> Oo 3r2 1 O ry Fy 3r2 3 —1 
0 1 = = 
3 3 


The row-reduced form of A is I, and so we conclude from the first part of 
the Invertibility Theorem that A is an invertible matrix. 


By the second part of the Invertibility Theorem, the final matrix on the 
right above must be AT}; that is, 


= 3 =] 
3 3 


You should check that this matrix is indeed the inverse of A. 
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To apply the Invertibility Theorem to find the inverse of a matrix A, we 
have to perform the same sequence of elementary row operations on both 
A and I. We can do this conveniently in the following way. We begin by 
writing A and I alongside each other, separated by a vertical line, giving a 
larger matrix, which we may denote by (A | I). We then row-reduce 

(A | I) in the usual way (with the check column included). When we do 
this, the above calculation is as follows. 


rı 1 3| 1 0\ 5 
ro 2 9| 0 dy 12 
1 3| 1 05 

ro > ro — 2r, 0 3] -2 1 2 
e 3 1 r) 5 

ro > $82 0 1 -é - Z 
rı > rı — 3re ¢ ol 3 1) 3 
2 1 2 

0 1)-3 3/3 


Thus the Invertibility Theorem (Theorem C7) gives us the following 
strategy. 


Strategy C3 


To determine whether or not a given square matrix A is invertible, 
and to find its inverse if it is, do the following. 


Write down (A | I), and row-reduce it until the left half is in 
row-reduced form. 


e If the left half is the identity matrix, then the right half is A7!. 


e Otherwise, A is not invertible. 


You may find it helpful to remember the following scheme for this strategy: 
(A | I) 
i 
(cl Aj), 


Strategy C3 is most useful for matrices of size 3 x 3 and larger. In Section 5 
you will revise a quick method for determining whether or not a 2 x 2 
matrix is invertible, and for writing down its inverse if it is invertible. 


Worked Exercise C16 


Determine whether or not each of the following matrices is invertible, and 
find the inverse if it exists. 


11 2 135 
(a) A=[-1 0 —4 (b) B=(3 17 
3 2 10 248 
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Solution 


®. We use Strategy C3, and again add the row-sum check to help pick 
up any arithmetical errors. © 


(a) We row-reduce the matrix (A | I). 


Yi 1 1 2 1 0 0 5 
r2 =I 0 =4 0 1 0} —4 
r3 S 2 10) © 0 il 16 
1 1 2 1 0 ON 95 
iby 2 Te ae eT 0 1 -2 1 1 0 il 
r3 > r3 — 3r, 0 —1 4| -3 0 1 il 
IE S Lis], S 15) 1 0 0 -l 0 4 
0 IL =2 1 1 Oy} i 
Teg pe 13 = IPR 0 0 2 | =2 1 Il 2 
1 0 4 Q = O\ 4 
0 il =2 1 1 O il 
r3 > 573 0 © 1;/-1 5 $/ 1 
Leith es Bale Ar3 1 0 0 4 —3 -2 0 
Ty) = Ley ap ZAP} 0 il © || ll 2 1} 3 
0 o a 5 $/ 1 


The left half has been reduced to I, so A is invertible; its inverse 
is given by the right half, that is, 


My 30 
(Ke a Po wil 
all 1 

=i 1 5 


2 
(b) We row-reduce (B | I). 


ry 1 3 5 1 0 O\ 10 
r2 3 il T 0 1 0 12 
ia 2 4 alo o 1 E 
1 3 5 il 0 0 10 
Po Eo efi To =a = | =s 1 0 e 
rg ig Ani pr) |S o ely 
1 3 5 1 0 0 10 
r2 > —gY2 O ea ge 
0 a ala 0 ees 
rı > rı — 3r2 il 0 9) —% 3 0 1 
0 1 1 - 4 0 
Psi hs erg 0 0 O;-3 -4 I) -3 


The left half is now in row-reduced form, but is not the identity 
matrix. Therefore B is not invertible. 
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If, for a general matrix A, it becomes clear while you are 

row-reducing (A | I) that the left half will not reduce to the identity 
matrix (for example, if a zero row appears in the left half), then you can 
stop the row-reduction immediately, and conclude that A is not invertible. 
There is no point in continuing until the left half is in row-reduced form. 


Exercise C30 


Use Strategy C3 to determine whether or not each of the following 
matrices is invertible, and find the inverse if it exists. 


2 4 1 1 —4 2 4 6 
(a) A= a i) (b) B=] 2 1 -6 (c) C={1 2 4 
—3 -1 9 5 10 5 


4.3 Invertibility and systems of linear 
equations 


We can use matrix inverses to give us another method for solving certain 
systems of linear equations. 


Consider the system that we solved by Gauss-Jordan elimination in 
Worked Exercise C1. 

2x + 4y = 10 

4r+ y=6 


You saw in Subsection 3.4 that such systems may be expressed in matrix 
form as 


690-0) 


In Exercise C30(a) you found that this coefficient matrix is invertible: 


—1 1 2 

G 1) O T ') 
_ 2 1 E 

oo 7 7 


Multiplying both sides of the matrix form of the system on the left by the 
inverse of the coefficient matrix, we obtain 


CE DEI DO): 


that is, 


(96) 


or 


So the system has the unique solution z = 1, y = 2. 
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In general, suppose that Ax = b is the matrix form of a system of linear 
equations, and that the coefficient matrix A is invertible. Then we can 
multiply both sides of the equation Ax = b on the left by AT! to yield 
A-'Ax = A~'b; that is, x = A~'b. It seems, then, that the system has 
the unique solution x = A~'b. 


However, we have to be careful before making this claim. Whenever we 
manipulate an equation in order to solve it, we have to be sure that the 
manipulation yields a second equation equivalent to the first (otherwise the 
two equations might have different solution sets). 


In this case, we have to be sure that 
Ax=b if and only if x=A'b. 


We showed above that if Ax = b, then multiplying both sides on the left 
by At yields x = A~'b; in other words, we proved that Ax = b implies 
x = A~'b. It remains to prove that x = A~'b implies Ax = b, and 
fortunately this is just as easy: if x = A~'b, then multiplying both sides 
of this equation on the left by A yields Ax = AA~'!b; that is, Ax = b. 


So multiplying both sides of Ax = b on the left by AT! does yield an 
equivalent equation. We have proved the following theorem. 


Theorem C8 


Let A be an invertible matrix. Then the system of linear equations 
Ax = b has the unique solution x = A~'b. 


Exercise C31 


Use Theorem C8 to solve the following system of linear equations. 


x y 22 = 1 
—£ — 4z7=2 
3x2 + 2y + 10z = -1 
In Worked Exercise C16 you saw that 
-1 


11 2 4 -3 -2 
-1 0 —4| =|-1 2 1 
10 -1 4 3 


In general, it is worth using the method of Theorem C8 only if we have 
already calculated the inverse of the coefficient matrix. To use the method 
of Theorem C8 to solve Ax = b, where A is an n x n invertible matrix, we 
first invert A. This involves row-reducing the matrix (A | I). We then 
calculate the matrix product A7~'b. On the other hand, the method of 
Section 2 using Gauss-Jordan elimination involves only row-reducing the 
matrix (A | b) and so is usually quicker. 
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Theorem C8 shows, in particular, that if the coefficient matrix A of a 
system of linear equations Ax = b is invertible, then the system has a 
unique solution. The converse of this result is also true — we prove this in 
the next theorem. 

This theorem gives some important relationships between the invertibility 
of a matrix and the number of solutions of a system of linear equations that 
has this matrix as its coefficient matrix. The theorem states that three 
conditions are equivalent: any one of the conditions implies any other one. 


Theorem C9 


Let A be an n x n matrix. Then the following statements are 
equivalent. 


(a) A is invertible. 


(b) The system Ax = b has a unique solution for each n x 1 
matrix b. 


(c) The system Ax = 0 has only the trivial solution. 


Proof We show that (a) => (b), (b) => (c) and (c) => (a), which 
shows that the conditions are equivalent. 

(a) => (b) 

Suppose that A is an invertible n x n matrix. Then, by Theorem C8, for 
any n x 1 matrix b, the system Ax = b has the unique solution x = A7'b. 
(b) = (c) 

Suppose that the system Ax = b has a unique solution for each n x 1 
matrix b. Then, in particular, the homogeneous system Ax = 0 has a 
unique solution. But every homogeneous system has the trivial solution; 
thus this unique solution must be the trivial one. 

(c) = (a) 

Suppose that the system Ax = 0 has only the trivial solution. Then 
row-reducing the augmented matrix 


ai @2 `: amn |O 
a21 a2 + an | 0 
Aml Am2 ''' Amn | 0 


of the system must yield 


1 Q- O10 
0 1 =s O|0 
0 0 sa 1/0 


since this is the row-reduced matrix that corresponds to each unknown 
being 0. If we now ignore the last column of each of the matrices 
appearing in this row-reduction, we are left with a reduction of A to I. 
Hence, by the Invertibility Theorem (Theorem C7), A is invertible. E 


4.4 Elementary matrices 


In this subsection you will meet a class of square matrices associated with 
elementary row operations and investigate their properties. 


We will use these matrices and their properties in Subsection 4.5 to help 
prove the Invertibility Theorem (Theorem C7). We will also find them 
useful later. 


Consider the following matrices: 


0 1 0 1 0 0 1 0 0 

1 0 O], 0 5 O], 0 1 0 

00 1 0 0 1 0 2 1 

They are obtained by performing, on the 3 x 3 identity matrix, the 
elementary row operations rı © r2, ro > dre and r3 > r3 + 2re, 


respectively. 


Definition 
A matrix obtained by performing an elementary row operation on an 
identity matrix is an elementary matrix. 


The elementary row operation that is performed to obtain an elementary 
matrix from an identity matrix is called the elementary row operation 
associated with that elementary matrix. 


We now demonstrate the most important property of elementary matrices. 
Below, we show the effect of multiplying the matrix 


1 2 3 4 
A=|5 6 7 8 
9 10 11 12 


on the left by each of the above elementary matrices. Notice that in each 
case, the resulting matrix is precisely the matrix that is obtained when the 
row operation associated with the elementary matrix is performed on A. 
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0 1 0 1 2 3 4 5 6 7 8 
1 0 0 5 6 7 8]= 1 2 3 4 
0 0 1 9 10 11 12 9 10 11 12 
elementary matrix A matrix obtained when 
associated with ror 
rı Ore is performed on A 
1 0 0 1 2 3 4 1 2 3 4 
0 5 0 5 6 7 8]= | 25 30 35 40 
00 1 9 10 11 12 9 10 11 12 
elementary matrix A matrix obtained when 
associated with rə > 5r2 
ro — 5re is performed on A 
1 0 0 1 2 3. 4 1 2 3 4 
010 5 6 7 8)]= 5 6 7 8 
02 1 9 10 11 12 19 22 25 28 
elementary matrix A matrix obtained when 
associated with r3 > r3 + 2r2 
r3 > r3 + 2re is performed on A 


There is nothing special about the above elementary matrices, or about 
the above matrix A. In the next exercise you will find that other 
elementary matrices behave similarly. 


Exercise C32 


1 2 3 


1 
3 
3 2 1 5 


Q AN 


Let A= ( ) and B= 


7 8 


(a) Write down the 2 x 2 elementary matrix associated with the 
elementary row operation rı > 5r1. 


Multiply A on the left by this elementary matrix, and check that the 
resulting matrix is the same as the matrix obtained when rı —> 5r, is 
performed on A. 


(b) Write down the 4 x 4 elementary matrix associated with the 
elementary row operation rg + ro + 3r4. 


Multiply B on the left by this elementary matrix, and check that the 
resulting matrix is the same as the matrix obtained when 
ro > r2 + 3r4 is performed on B. 


Notice that the number of columns of the elementary matrix used must 
equal the number of rows of the matrix upon which the elementary 
operation is to be performed; that is, the elementary row operations should 
be applied to an appropriately sized identity matrix to obtain the 
elementary matrix required. 


In general, we have the following theorem, which we state without proof. 


Theorem C10 


Let E be an elementary matrix, and let A be any matrix with the 
same number of rows as E. Then the product EA is the same as the 
matrix obtained when the elementary row operation associated with 
E is performed on A. 


Theorem C10 tells us that if we perform an elementary row operation on a 
matrix A with m rows, then the resulting matrix is EA, where E is the 
m x m elementary matrix associated with the row operation. 


What happens if we perform a sequence of k elementary row operations on 
a matrix A with m rows? Let E4, E2,..., Ep be the m x m elementary 
matrices associated with the row operations in the sequence, in the same 
order. The first row operation is performed on A, producing the matrix 
EA; the second row operation is then performed on this matrix, 
producing the matrix E2(E1A) = E2E1 A; and so on. After the whole 
sequence of k row operations has been performed, the resulting matrix is 
E,Ep_1---E gE, A. Notice that the order of the elementary matrices in 
this matrix product is the reverse of the order in which their associated 
row operations are performed. 


This fact will be useful later, and we record it as a corollary to 
Theorem C10. 


Corollary C11 


Let E1, Eo,..., Ep be the m x m elementary matrices associated with 
a sequence of k elementary row operations carried out on a matrix A 
with m rows, in the same order. Then, after the sequence of row 
operations has been performed, the resulting matrix is 


PERCALE 


For example, earlier, to illustrate the Invertibility Theorem (Theorem C7), 
we performed the sequence of row operations 


Yo > Yq— 2r r> iro, rı > rı — 3ro, 
on the matrix 
1 3 
A= 
to produce the identity matrix Ib. 


By Corollary C11 we have the following, which you should check by 
evaluating the product on the right-hand side. 


(0 i)= (0 a) G2 DG 9) 
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We now explore some other useful connections between elementary row 
operations and elementary matrices. We begin by introducing a further 
property of elementary row operations. 


In the following example, the second elementary row operation undoes the 
effect of the first. 


rı L 2 3 
TQ 4 5 6 

1 2 3 
ro > r2 + 3r1 7 11 15 


L 2 8 
to > r2 — 3r] 4 5 6 


In fact, given any elementary row operation, it is easy to write down an 
inverse elementary row operation that undoes the effect of the first, as 
summarised in the following table. 


Elementary row operation Inverse elementary row operation 
ri © rj ri © rj 
rjocr, (c#0) r; > (l/c) ri 
ri > ri + cr; ri > ri — cr; 


Exercise C33 


Write down the inverse of each of the following elementary row operations. 
Check your answer in each case by carrying out the sequence of two row 
operations on the matrix 


12 3 
A=(j 5 ae 


(a) rı > rı — 2r2 (b) rı Ore (c) r2 + —3r2 


Note that if two elementary row operations are such that the second is the 
inverse of the first, then the first is the inverse of the second — so it makes 
sense to say that they are inverses of each other, or that they form an 
inverse pair. For example, the inverse of rg > rə + 3r, is rə > re — 3r, 
and the inverse of rə > rə — 3r, is rə > rə — (—3)rj, that is, ro > rə + 3r1. 
So rə > ro + 3rı and rg — rə — 3r, are inverses of each other. 


Now consider the following pair of 2 x 2 elementary matrices associated 
with the inverse pair of elementary row operations rg > ra + 3r; and 
r2 > Yo — 3r]: 


(3 1)» (e 1) 


These two matrices are themselves inverses of each other, as we can easily 
check: 


(Gs = = DG») 


This connection between inverse pairs of elementary row operations and 
inverse pairs of elementary matrices holds in general. 


Theorem C12 


Let E and Es be elementary matrices of the same size whose 
associated elementary row operations are inverses of each other. Then 
E; and Ep» are inverses of each other. 


Proof In this proof we refer to the row operations associated with E1 
and Ez as row operation 1 and row operation 2, respectively. 


By Corollary C11, E2E I is the matrix produced when row operations 1 
and 2 are performed, in that order, on I. Similarly, Ey FoI is the matrix 
produced when row operations 2 and 1 are performed, in that order, on I. 
But each of these two row operations undoes the effect of the other, so 
EEI = I and E Eol = I; that is, 


EE; = I = E E9. 


Thus E; and Ep are inverses of each other. E 


Theorem C12 has the following corollary. 


Corollary C13 


Every elementary matrix is invertible, and its inverse is also an 
elementary matrix. 


Proof Let E be an elementary matrix. Then E has an associated 
elementary row operation. This associated elementary row operation has 
an inverse operation, and the elementary matrix of the same size as E 
associated with this inverse operation is the inverse of E, by 

Theorem C12. E 


Exercise C34 


Use the method suggested by the proof of Corollary C13 to find the inverse 
of the elementary matrix 
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4.5 Proof of the Invertibility Theorem 


We are now ready to prove the Invertibility Theorem, using elementary 
matrices and their properties. We first remind you of the theorem. 


Theorem C7 Invertibility Theorem 


(a) A square matrix is invertible if and only if its row-reduced form 
is I. 

(b) Any sequence of elementary row operations that transforms a 
matrix A to I also transforms I to A~!. 


Proof Let A be an n x n matrix, and let the row-reduced form of A 

be U. Let Ey, Eo,..., Ep be the n x n elementary matrices associated with 
a sequence of k elementary row operations that transforms A to U. Then, 
by Corollary C11, 


U=BA, 


where B = E, Ex_ 1 --: Eg E;. Now B is invertible — since every elementary 
matrix is invertible (by Corollary C13), and a product of invertible 
matrices is invertible (by Theorem C5). 


(a) ®. We start by proving the only if statement. © 
First we show that if A is invertible, then U = I. 


Suppose that A is invertible. Then U is a product of invertible 
matrices (B and A); hence U is invertible. 


Therefore U does not have a zero row (since, by Theorem C4, a 
square matrix with a zero row is not invertible), and so from the 
definition of row-reduced form, it has a leading 1 in each of its n rows. 
Each of these n leading ones lies in a different column; so, since U has 
only n columns, each column must contain a leading 1. Thus the 
leading 1 in the top row must lie in the left-most position, and the 
leading 1 in each subsequent row must lie just one position to the 
right of the leading 1 in the row immediately above. All the entries 
above and below these leading ones are zeros. Hence U = I. 


®. We now prove the if statement. .©& 
Next, we show that if U =I, then A is invertible. 


Suppose that U =I. Then 
I= BA. (5) 


Multiplying both sides of equation (5) on the left by B~! yields 
B'I=B''BA, 

that is, 
Bo =A. 

Multiplying both sides of this equation on the right by B yields 


B-'B = AB, 
that is, 
I= AB. (6) 


Equations (5) and (6) together tell us that A is invertible, and that 
A =B. 


(b) It follows from the proof of part (a) that if U =I, then A is invertible 
and A~! = B; that is, A7! = E,E,_1--- EE}. 
This equation can be written as 
A`! = ExEx-1--- E2E;I, 


which tells us that A~! is the matrix produced by performing on I 
the sequence of row operations associated with E4, Eo,..., Ex. | 


5 Determinants 


In this section you will revise the determinant of a 2 x 2 matrix, and see 
how this concept extends to n x n matrices. 


5.1 Systems of linear equations and 
determinants 


Determinants arise naturally in the study of systems of linear equations. 


In 1693 Gottfried Wilhelm Leibniz (1646-1716) wrote a letter to the 
Marquis de l’Hopital in which he demonstrated a method for solving a 
system of three simultaneous equations which involved calculating 
what we now call the determinant of a 3 x 3 matrix, and went on to 
give a general (although rather unclear) rule for calculating the 
determinant of an n x n matrix. 


The actual term ‘determinant’ was introduced by Carl Friedrich 
Gauss (1777-1855) in his Disquistiones Arithmeticae of 1801, but it 
was Augustin-Louis Cauchy (1789-1857) who in 1812, adapting the 
term from Gauss, first used it in its modern sense and began to 
develop a proper theory of determinants. 
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This connection between determinants and systems of linear equations was 
made explicit by Gabriel Cramer in a method known as Cramer’s rule. If a 
unique solution exists for a system of n linear equations in n unknowns, 
then this solution can be found by evaluating determinants. You will see 
Cramer’s rule for a system of two linear equations in two unknowns; it is 
rather unwieldy to use for larger systems. However, Cramer’s rule gives an 
expression for each unknown individually, so it makes it possible to find 
one unknown without solving the whole system. 


Cramer’s rule is named after the Swiss mathematician Gabriel Cramer 
(1704-1752) who presented it in his Introduction à l'analyse des lignes 
courbes algébriques (Introduction to the Analysis of Algebraic Curved 
Lines) of 1750, although the Scottish mathematician Colin Maclaurin 
(1698-1746) had already described the rule in his Treatise of Algebra 
(1748) written in 1730 but not published until after his death. 


Determinant of a 2x2 matrix 


We start by looking at a system of two equations in two unknowns, where 
the coefficients of the system are real numbers. 


aix + biy = cy a, b,\ (x c 
or = : 
agx + boy = cg az bo) \y C2 
Using Gauss-Jordan elimination, the following solution can be found, 
cb — bico a1C2 — C142 


s= 2 ae, y ae an (7) 


aiba — biag aiba — biaz’ 


provided that a ,bz — b1a2 is not zero. (You can check this solution by 
substitution.) We call the expression a1b2 — biaz the determinant of the 
coefficient matrix. Each term in this expression contains the letters a and 
b, and the subscripts 1 and 2, in some order. 


The definition we give for the determinant of a 2 x 2 matrix is in a form 
that is easier to remember. 


Definition 


The determinant of a 2 x 2 matrix 
@ D 
a= (ti) 


a b 
det A= A 


is 


|= ad te 


5 Determinants 


You might find it helpful to remember the scheme shown in Figure 15. a b 
We write det A, and use vertical bars ‘| ... |’ around the matrix entries, in 
place of the round brackets, to denote the determinant. Some texts use the d 
notation |A| rather than det A. e 
1 2 Figure 15 Scheme for 2 x 2 
For example, let A = f A then determinant 
1 2 
det A = 3 4 = (1x 4) — (2x 3) = -2. 


Exercise C35 


Evaluate the determinant of each of the following matrices. 
5 1 10 —4 7 3 
i ({ À (e e 2) (©) (i J 


Notice that the numerators of the solutions for x and y in (7) can also be 
written as determinants: 


cy b a, ĉl 
c1b2 — bicg = and a@1c2 — C102 = . 
C bə ag C2 
So we could write these solutions as 
cy b ay Cy 
c2 b2 a2 C2 
p= , y= Ám. 
ay by ay bi 
a2 b2 az bg 


This is Cramer’s rule for a system of two linear equations in two 
unknowns. The numerator of the expression for x is the determinant of the 
coefficient matrix of the system with the first column replaced by the 
constant terms. Similarly, the numerator of the expression for y is the 
determinant of the coefficient matrix of the system with the second column 
replaced by the constant terms. 


In Subsection 5.4 we will prove that a 2 x 2 matrix is invertible if and only 
if its determinant is non-zero. For an invertible 2 x 2 matrix, there is a 
quick way to find the inverse using the determinant. You can verify the 
following strategy by checking that the expression given below for AW! 
does indeed satisfy AAT! =I = ATHA. 
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Strategy C4 
To find the inverse of a 2 x 2 matrix 
a b 
Sled 
with det A = ad — bc £0: 
e interchange the diagonal entries 


e multiply the non-diagonal entries by —1 


e divide by the determinant of A, giving 


1 do 
BS ! 
ad — be & n 


Exercise C36 


Determine whether or not each of the following matrices is invertible, and 
find the inverse if it exists. 


oka olid ©( 4) 


There is also a geometric interpretation of the determinant: let (a,c) and 
(b, d) be two position vectors. Then the determinant 


a b 
c d 


gives the area of the parallelogram with adjacent sides given by these 
position vectors. For example, the parallelogram shown in Figure 16 with 
vertices (0,0), (2,1), (1,3) and (3,4) has area 5, since the base and height 
are both equal to v5. Now, since one of the vertices is at the origin, the 
position vectors (2,1) and (1,3) determine the parallelogram, and 

2 1 
i 3 
Determinant of a 3x3 matrix 


We now consider the following system of three linear equations in three 


= (2x 3)—(1* 1) =5. 


unknowns: 
ax + biy + c12 = dı a b a x dı 
agx + boy + coz = d2 or a2 b2 C2 y| = | do 
agx + b3y + c3z = d3 a3 b3 cg zZ d3 


Again we can find the solution, if one exists, using Gauss-Jordan 
elimination. It turns out that the solutions for x, y and z all have the same 
denominator: 


a1b2c3 — a1c2b3 — b1a2c3 + bic2a3 + c1a2b3 — c1b203. 


This is the determinant of the 3 x 3 coefficient matrix. Notice that each 
term in this expression for the denominator contains the letters a, b and c, 
and the subscripts 1, 2 and 3, in some order. 


The definition we give for the determinant of a 3 x 3 matrix is expressed in 
terms of three 2 x 2 determinants. This is the easiest way to remember the 
definition. 


Definition 


The determinant of a 3 x 3 matrix 


ay by Cil 
A= a2 bz C2 
a3 b3 C3 
is 
bg ¢ a2 ¢ ag b 
det A = aj 2 aes: 2 Al io A E 
0 6 a3 C3 az b3 


Notice the minus sign before the second term on the right-hand side. 


Worked Exercise C17 


Evaluate the determinant of each of the following 3 x 3 matrices. 


12 1 4 01 
(a) | 3 1 -1 (b) [0 -1 2 
-2 1 1 2 13 
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Exercise C37 


Evaluate the determinant of each of the following 3 x 3 matrices. 


3 2 1 2 10 0 
(a) [4 0 -1 (by [3 -1 2 
0—1 1 5 92 


Determinants of larger matrices (4 x 4, and so on) are defined similarly in 
terms of smaller determinants in the next subsection. Note that 
determinants are defined only for square matrices. As with 2 x 2 matrices, 
determinants of larger matrices can be used to solve systems of linear 
equations. 


5.2 Evaluating determinants 


You have seen that although the determinant of a 2 x 2 matrix is simple to 
evaluate, the determinant of a 3 x 3 matrix is quite complicated. 
Determinants of larger matrices become increasingly more complicated as 
the size of the matrix increases. You will mainly be finding determinants of 
matrices of size 2 x 2 and 3 x 3. In this subsection we develop a strategy 
for evaluating determinants by expressing them eventually in terms of 
determinants of 2 x 2 matrices, as with the definition of the determinant of 
a 3 x 3 matrix above. 


Cofactors 


A submatrix is a matrix formed from another matrix with some of the 
rows and/or columns removed; submatrices are useful when evaluating 
determinants. 


We can express the determinant of a 3 x 3 matrix A = (a;;) conveniently as 
det A = a11411 + a12412 + 413.413. 


The elements A11, A12 and Aj3 in this expression are called the cofactors 
of the elements a11, a12 and a13, respectively. We can see from the 
definition of the determinant that these cofactors are themselves 
determinants with a + or — sign attached. In fact, Ai; is (—1)!+Ħ} times 
the determinant of a submatrix of A formed by removing the top row and 
one column of A — namely the row and column containing the element arj. 


Thus for Aj; we have 


a a 
so A= 22 23 
a32 433 
a21 a2 
SO Ajo = — . 
a31 433 
a a 
so A3 = 21 22| 
a31 432 


In fact, there is a cofactor associated with each entry of any square matrix. 


Definition 
Let A = (aij) be an n x n matrix. The cofactor Aj; associated with 
the entry aj; is 
Ai = (D det Ayj, 
where Aj; is the (n — 1) x (n — 1) submatrix of A resulting when the 


ith row and jth column (the row and column containing the entry aij) 
are removed. 


For example, for the cofactor Ag3 of the 4 x 4 matrix A = (aij) we have 


Q11 412 414 
so Ao3 = — |a31 32 434]. 
a41 Q42 G44 


Exercise C38 


Write down expressions for the cofactors A13 and A45 of the matrix 


123 4 5 
23 4 5 1 
A=]3 4 5 1 2 
45 12 3 
5 12 3 4 


(Do not attempt to evaluate these expressions!) 
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Determinant of an nxn matrix 


You have seen that we can use cofactors to evaluate the determinant of a 
3 x 3 matrix. Determinants of larger matrices can be evaluated in a similar 
way. 


Definition 


The determinant of an n x n matrix A = (aij) is 


wa G12 ~ Gin 

Gi, Cpa ee Opp 
det ASIA ; 

Ani an2 °*** Ann 


= anA sb aaia P oe se Onin 


Do not forget the minus sign that is a part of alternate cofactors! 


The determinant of a matrix is a complicated string of terms. The 
definition above collects the terms into manageable expressions using the 
cofactors of the entries of the top row; when we write the determinant in 
this way, we say that we are expanding along the top row. 


There are alternative expansions for the determinant of a square matrix 
that collect the terms in different ways — however, the resulting value for 
the determinant is always the same. 


We are now in a position to evaluate the determinant of any square matrix 
using the following strategy. 


Strategy C5 
To evaluate the determinant of an n x n matrix: 


1. expand along the top row to express the n x n determinant in 
terms of n determinants of size (n — 1) x (n — 1) 


2. expand along the top row of each of the resulting determinants 


3. repeatedly apply step 2 until the only determinants in the 
expression are of size 2 x 2 


4. evaluate the final expression. 


Figure 17 gives a scheme for an n x n determinant. 


[det A) 


| 


TA 
FO Ga, FOO, 


Figure 17 Scheme for an n x n determinant 


Worked Exercise C18 illustrates Strategy C5, before you are asked to find 
the determinant of a 4 x 4 matrix in Exercise C39. 


Worked Exercise C18 


Evaluate the following determinant. 
20 35 


0 4 -1 0 
10 0 1 
02 1 1 


Exercise C39 


Evaluate the following determinant. 


02 1 =l 
=3 0 0 =i 
101 0 
0 4 2 0 


5 Determinants 


81 


Unit C1 Linear equations and matrices 


82 


5.3 Properties of determinants 


Suppose that A and B are two n x n matrices. Are there any relationships 
between det A, det B, det(A + B) and det(AB)? 


Exercise C40 


—3 1 1 1 
Let A = ( 9 e adB=(_; s 
Evaluate det A, det B, det(A + B), det(AB) and (det A)(det B). 


Comment on your results. 


You should have found in the solution to Exercise C40 that there does not 
appear to be a simple relationship for the addition of determinants; that is, 
we cannot easily express det(A + B) in terms of det A and det B. 
However, the identity 


det(AB) = (det A) (det B) 


does hold for all square matrices A and B of the same size. The simplicity 
of this result is somewhat surprising, given the complexity of the 
definitions of matrix multiplication and the determinant. 


We collect together, without proof, some results about determinants in the 
following theorem. 


Theorem C14 


Let A and B be two square matrices of the same size. Then the 
following hold: 


(a) det(AB) = (det A)(det B) 
(b) detI=1 
(c) det AT = det A. 


Elementary operations and determinants 


Earlier, in Theorem C10, you saw that multiplication on the left by an 
elementary matrix has the same effect as applying the associated 
elementary row operation. Here, we use elementary matrices to prove some 
useful results about determinants. 


Exercise C41 


Evaluate the following determinants, where k is any real number. 
1 0 0 0 


(a) ©) |p 
0 


or © 
re Oo © 


1 
a 
0 


100 () 
0 k 0 lh 1 
001 


The results of Exercise C41 are particular cases of the following theorem. 
The proof is not hard, but it is not very illuminating, so is not given here. 


Theorem C15 

Let E be an elementary matrix, and let k be a non-zero real number. 
(a) If E results from interchanging two rows of I, then det E = —1. 
(b) If E results from multiplying a row of I by k, then det E = k. 


(c) If E results from adding k times one row of I to another row, 
then det E = 1. 


Zeros in a matrix greatly simplify the calculation of the determinant. If an 
entire row of the matrix is zero, then all the terms vanish and the 
determinant is zero. Some other matrices with zero determinant are also 
easy to recognise. 


Theorem C16 

Let A be a square matrix. Then det A = 0 if any of the following hold: 
(a) A has an entire row (or column) of zeros 

(b) A has two equal rows (or columns) 


(c) A has two proportional rows (or columns). 


Proof We prove the statements for rows. The results for columns follow, 
as Theorem C14(c) states that taking the transpose does not alter the 
determinant of a matrix. 


(a) ®. We follow Strategy C5 and expand along the top row of A, and 
continue by expanding along the top row of the resulting 
determinants until the only determinants in the expression are of size 
2 x 2. The first term of the full expansion is therefore the product 
41022033 °**Gnn, and each other term similarly comprises a product 
containing one entry from each row and each column. .® 
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Each term in the full expansion of the determinant of A is a product 
containing one entry from each row and each column of A. If an 
entire row of A is zero, then each term of this expansion contains at 
least one zero, and so each term is zero. Hence the determinant of A 
is equal to zero. 

(b) Ifthe ith and jth rows of the matrix A are equal, then A remains the 
same if these rows are interchanged. Let E be the elementary matrix 
obtained by interchanging the ith and jth rows of I. Then EA = A. 
Using Theorems C14 and C15, we have 


det A = det(EA) = (det E)(det A) = —1 x det A. 
This implies that det A = 0, as required. 


(c) ®. Two rows (or columns) of a matrix are proportional when one is a 
multiple of the other. © 


Suppose that the ith row of A is equal to k times the jth row. Let E 
be the elementary matrix obtained from I by multiplying the ith row 
by 1/k. Then the ith and jth rows of the matrix EA are equal. The 
determinant of this matrix EA is zero, by (b) above. Using 
Theorem C14, we have 

(det E)(det A) = det(EA) = 0. 


Now det E = 1/k, by Theorem C15. This implies that det A = 0, as 
required. a 


Exercise C42 


Evaluate the determinant of the matrix 


1-2 4 
A= 0 13 11 
—2 4 -8 


Theorem C15(a) and Theorem C14(a) together mean that if B is a matrix 
obtained from a matrix A by interchanging a pair of rows, then 

det B = — det A. Therefore the evaluation of the determinant can be 
significantly simplified if a row of the matrix contains some zeros, as the 
following worked exercise illustrates. 


Worked Exercise C19 


Evaluate the determinant of the following matrix. 


Exercise C43 


Evaluate the determinant of the following matrix. 


10 3 —4 2 

02 0 1 

aie 0 6 00 
-1 2 10 


5.4 Determinants and inverses of matrices 


Earlier, in Subsection 5.1, we stated that the inverse of a 2 x 2 matrix A 
exists if and only if det A Æ 0. This extends to all square matrices. 


Theorem C17 
A square matrix A is invertible if and only if det A 4 0. 


Proof Let A be ann x n matrix. 
®. We start by proving the only if statement. .@ 
First we show that if A is invertible, then det A 4 0. 


Suppose that A is invertible. Then since AA~! = Iņ, it follows from 
Theorem C14 that 


(det A)(det A7!) = det(AA~!) = det I, = 1. 
Therefore neither det A nor det AT! is 0. 
®. We now prove the if statement. & 
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Next we show that if det A Æ 0, then A is invertible. 


Now suppose that det A 4 0. Let E,,..., Ep be elementary matrices such 
that Ep- -- E2E1A = U is matrix A in row-reduced form. Using 
Theorems C14 and C15 and the assumption that det A Æ 0, we have 


det U = (det Ez) -- - (det E2) (det E,)(det A) # 0. 


Now this implies that U has no zero row, and therefore has a leading 1 in 
each of its n rows. Hence U = I,, and so, by the Invertibility Theorem 
(Theorem C7), the matrix A is invertible, with 


A`! = Ep- EE). | 


We saw in the proof of Theorem C17 above that if A is invertible, then 
(det A)(det A~!) = 1. This gives the following useful result. 


1 
det A7! = —— 
Á det A 


Until now, if we wanted to show that an n x n matrix A is invertible, we 
had to produce an n x n matrix B such that 


AB =I = BA. 


The next theorem shows that if one of these conditions holds, then the 
other holds automatically. Thus if we want to show that an n x n matrix 
A is invertible, it is enough to produce an n x n matrix B satisfying either 
condition. 


Theorem C18 


Let A and B be square matrices of the same size. Then AB = I if 
and only if BA =I. 


Proof ®. We start by proving the only if statement. @ 
First we show that if AB =I, then BA =I. 
Suppose that AB = I. Then, by Theorem C14, 
(det A)(det B) = det(AB) = det I = 1. 
This implies that 
de A #0 and detB #0, 
so, by Theorem C17, A and B are both invertible. 
Now, 
A7! = ATTI, 
and we can write I as AB, so 
A = A`! (AB) = (A A)B = IB = B, 
and therefore 
BA = A™A =], 


as required. 


5 Determinants 


®. To prove the if statement we have to show that if BA =I, then 
AB =I. We can use exactly the same argument as above with A and B 
exchanged. .@ 


The same argument, with the roles of A and B interchanged, proves the 
converse. o 


We summarise the results on the invertibility of a matrix A as follows. 
This one theorem collects together Theorems C7, C9 and C17. 


Theorem C19 Summary Theorem 


Let A be an n x n matrix. Then the following statements are 
equivalent. 


(a) A is invertible. 

(b) det A 40. 

(c) The row-reduced form of A is Iņ. 
( 


d) The system Ax = b has precisely one solution for each n x 1 
matrix b. 


(e) The system Ax = 0 has only the trivial solution. 


To conclude this section, we collect together some of the most important 
properties of matrices from this unit. 


Summary of properties of matrices 


Let A and B be two square matrices of the same size. Then 
det(AB) = (det A)(det B), 
(AB)? = BA’, 
det A? = det A. 
If A and B are invertible, then 
(AB) =B A] 
1 


dt A === 
5 det A 
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Summary 


In this unit you have seen that systems of linear equations can have no 
solution, a unique solution or infinitely many solutions, and you have used 
Gauss-Jordan elimination to solve such systems. You have seen that 
matrices can be used in two different ways to represent systems of linear 
equations: both as an augmented matrix and as a matrix equation in 
which the coefficient matrix is multiplied on the right by the matrix of 
unknowns to give the matrix of constant terms. You studied how 
properties of matrices relate to properties of the corresponding systems of 
linear equations. In particular, you saw that if the coefficient matrix of a 
system of linear equations is invertible, or equivalently, if the determinant 
of the coefficient matrix is non-zero, then the system has a unique solution. 
You also saw that the set of m x n matrices with real entries forms an 
abelian group under addition and that the set of n x n invertible matrices 
with real entries forms an abelian group under matrix multiplication. 


You will encounter systems of linear equations throughout the linear 
algebra units, along with matrices and their properties. Matrices will also 
appear in the group theory units, in particular you will work with the 
group of invertible 2 x 2 matrices in Book E. 


Learning outcomes 


Learning outcomes 


After working through this unit, you should be able to: 


e understand the connection between the solutions of systems of linear 
equations in two and three unknowns, and the intersection of lines and 
planes in R? and R? 


e explain the terms solution set, consistent, inconsistent and homogeneous 
system of linear equations 


e use the method of Gauss—Jordan elimination to find the solutions of 
systems of linear equations 


e describe the three types of elementary operation and elementary row 
operation 


e recognise whether or not a given matrix is in row-reduced form and 
row-reduce a matrix 


e write down the augmented matrix of a system of linear equations, 
recover a system of linear equations from its augmented matrix, and 
solve a system of linear equations by row-reducing its augmented matrix 


e perform the matrix operations of addition, multiplication and 
transposition 


e recognise the following types of matrix: square, zero, diagonal, lower 
triangular, upper triangular, identity, symmetric 


e express a system of linear equations in matrix form and state the 
relationship between the invertibility of the coefficient matrix and the 
number of solutions of the system 


e understand what is meant by an invertible matrix and determine 
whether or not a given matrix is invertible and, if it is, find its inverse 


e understand that the set of n x n invertible matrices with real entries 
forms a group under matrix multiplication 


e understand the connections between elementary row operations and 
elementary matrices 


e understand the term determinant of a square matrix, evaluate the 
determinant of a 2 x 2 matrix and expand along the top row to calculate 
the determinant of larger matrices 


e use determinants to check whether or not a matrix is invertible. 
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Solutions to exercises 


Solution to Exercise C1 
(a) This is a linear equation. 


(b) This is not a linear equation. The third term 
involves the product of 73 and z4. 


(c) This is a linear equation (although not all of 
the five unknowns appear in this equation). 


(d) This is not a linear equation. For example, the 
second term, a273, involves a product of unknowns. 


Solution to Exercise C2 


A general homogeneous system of m linear 
equations in n unknowns is 


aiti +++: + Gintn =0 
a21%1 +++: + aantn = 0 


amitti +++: + Amntn = 0. 


We substitute the values 71 = 0, z2 =0,..., 
Ln = 0 into the equations of the system: 


a0 +--+ + int = 0 
a210 +: + am0 = 0 


am10 +--+: + Gmn0 = 0. 


All the equations are satisfied, whatever the values 
of the coefficients a;;. The solution set therefore 
contains the trivial solution 


x, =0, rq = 0, teeny ta =i. 


Solution to Exercise C3 
We label the equations and apply elementary 
operations to simplify the system. 


r+y=4 
2x =y= D 


rı 
r2 


First we eliminate the unknown x from the second 
equation. 


r+ y=4 


ro > ro — 2r1 — 3y = —3 


We then simplify this equation. 


r+y=4 
r2 > —$r2 y=1 


We use it to eliminate the unknown y from the 
first equation of the system. 

Lr=3 

y=1 


ry —> ri = fs 


We conclude that there is a unique solution: x = 3, 
y=. 

The method above eliminates the unknowns in 
order; you may have begun by performing the 
elementary operation rı > rı + re to eliminate y 
from rı. This is also correct. 


Solution to Exercise C4 


The explanations in between the systems of three 
linear equations are not a necessary part of the 
solution: they are included for clarity. 


We label the equations and apply elementary 
operations to simplify the system. 


rı r+ y- z=8 
r2 2r— y+ z=1 
r3 =t + 3y +22 = =8 


First use the rı equation to eliminate the unknown 
x from the other equations. 


r+ y- z=8 
to > r2 — 2rı — 3y + 3z = —15 
r3 > r3 + rı 4y+ z=0 
Now simplify rə. 
r+ y-z=8 
ro > — $r? y=7=5 
4y+2=0 


Then use rə to eliminate the y-terms from rı 
and r3. 


=5 
z=5 
5z = —20 


ri 7T, —Y2 T 
y= 
r3 > r3 — 4r2 


Now simplify r3. 
x =3 
y—-z=5 
r3: —> trs z=-A4 


Then use r3 to eliminate the z-term from ro. 


C3 
r2 > r2 + r3 y=] 
z= —4 


We conclude that there is a unique solution: x = 3, 
y= 1, z = —4. 
Solution to Exercise C5 


We label the equations and apply elementary 
operations to simplify the system. 


rı zr +3y— z=4 
r2 —gz + 2y — 4z = 6 
r3 x + 2y = 2 

r+ 3y- z=4 
ro > Yot+ ri oy — 5z = 10 
r3 —> r3— Tí = z= -2 


r+ 3y—z=4 


ro > iro y—-z=2 
—y +z =-2 

rı > rı — 3r2 x +2z=-2 
y= z2=2 

r3 > r3 + r2 0=0 


(The r3 equation (0 = 0) gives no constraints on z, 
y and z.) 


There are insufficient constraints on the unknowns 
to determine them uniquely, so the system has an 
infinite solution set. 


(As both remaining equations involve a z-term, set 
z equal to the real parameter k.) 


We write the general solution as 


= -2-2k, y=2+k, z=k, KER. 


You may have spotted that rə (y — z = 2) and r3 
(—y + z = —2) were multiples of each other, and 
concluded earlier that there are infinitely many 

solutions; however, the solutions are still needed. 


Solutions to exercises 


Solution to Exercise C6 


We label the equations, and apply elementary 
operations to simplify the system. 


rı Fy z=6 
r2 gEby— 32S -2 
r3 2x +y+3z=6 


to 9 r2 + r1 2y—2z=4 
r3 => r3 = 2rı = —6 

t+ ytz=6 
ro —> iro y= 2 
rı > rı — r2 x +2z=4 

y— z=2 
r3 > r3 +r2 = —4 
The r3 equation is 0 = —4, so we conclude that the 


solution set is empty: the system is inconsistent. 


You may have spotted that the system is 
inconsistent at an earlier stage and therefore 
stopped then. 


Solution to Exercise C7 
Let the equation of the plane be 


ax + by + cz = d, 


where a, b, c and d are real, and a, b and c are not 
all zero. 


Substituting the points into the equation gives a 
system of three linear equations in the unknowns 
a, b and c. We label the equations and apply 
elementary operations to simplify the system. 


rı a +2c=d 
r2 3b+4c=d 
r3 a + b+3c=d 
a +2c=d 
3b + 4c=d 
r3 > r3 — ri b+ c=0 
a +2c=d 
ro > ro — 3r3 c=d 
b+ c=0 
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a +2c=d 

roe I3 b+ c=0 

c=d 
rı > rı — 2r3 a=-—d 
ro => £9 — T3 b= -d 
c=d 


We conclude that this system has a unique solution 
(in terms of d): a= —d, b= —d, c= d. 


We substitute these expressions into the equation 
for the plane to get 


—dx — dy + dz = d. 
Dividing through by —d yields a simpler equation 
for the plane: 


ety-z=-l1. 


Solution to Exercise C8 


The two unknowns are my sister’s age and my 
brother’s age; let us denote these by s and 6 (in 
years), respectively. 


The first statement of the problem now translates 
to the equation 


s +b = 40, 
and the second statement to 
b=s+12. 


We write these two equations in the usual form 
and label them. 

s+b=40 
-s +b=12 


rı 


r2 


We apply elementary operations to simplify this 
system. 


s+ b=40 
Yo > rə + ri 2b = 52 

s5+b=40 
ro > ro b = 26 
rı > rı — r2 s= 14 

b = 26 


The system has a unique solution: s = 14, b = 26. 


The answer to the problem is that my sister is 
14 years old. 


Solution to Exercise C9 


(a) The augmented matrix of the system is 


4 =2 0|-7 
0 1 3] 0 
0 —3 1 3 


(b) The corresponding system is 
+ 7w=1 

= 
w= 2. 


2x + 3y 
y= Tz 
m + 3z—- 


Solution to Exercise C10 


(a) This matrix is not row-reduced as it does not 
have property 3. 
(b) This matrix is row-reduced. 


(c) This matrix is not row-reduced as it does not 
have property 4. 


Solution to Exercise C11 


(a) The augmented matrix corresponds to the 
system 


Ty 


WIN whe 


T2 


2 


The solution is zı = $, T2 = Å. 


(b) The augmented matrix corresponds to the 
system 


Ti + 6z3 = 0 
z2 + 773 = 0 
O=, 


The third equation cannot be satisfied, so there are 
no solutions. 


(c) The augmented matrix corresponds to the 
system 


£1 + 3x2 + 2x4 = —7, 
z3 — 3x4 = 8, 
5 =M, 
that is, 
v1 = —T7 — 3x9 — 244 
v3 = 8+ 3x4 
v5 = 11. 


Setting x2 = k and z4 = l (k,l € R), we obtain the 


general solution 
zı = —7 — 3k — 2l, 


(d) The augmented matrix corresponds to the 


T2 = k, 
z3 = 8 + 3l, 
T4 = l, 
T5 = 11. 
system 
Zi + xz4=0 
T2 + 424 = 3 
T3 =() 
that is, 
Tı = T4, 


£T? = 3 — 424, 


Setting x4 = k (k € R), we obtain the general 


%3 = 0. 
solution 

T1 = —k, 

T2 = 3— 4k, 

x3 =0, 

LA = k. 


Solution to Exercise C12 


(a) Strategy C1 gives the following sequence of 


row operations. 


rı 1 5 1 4 5-1 15 
ro 1 5 3 12 11 3] 35 
r3 3 15 -1—4 3-6] 10 
r4 —2 —10 1 2-7 6/-10 
15 1 4 5 =1 15 
Ys > Y2 = r] 00 2 8 6 4 20 
r3 > r3 — 3r1 0 0 —4 -16 -12 -3 35 
r4 > r4 + 2r, 00 3 10 3 4 20 
15 1 4 5 =1 15 
ro > $62 i 0 1 4 3 2| 10 
0 0 —4 -16 -12 -3 35 
00 3 10 3 4 20 
ri > Yr, —Yf2 150 0 2 —3 5 
001 4 3 2 10 
r3 — r3 + 4r2 000 0 0 5 5 
ra= ra= 3t9 00 0—2 -6 =2 10 


15 
00 
r3 © r4 00 
00 
15 
00 
r3 > —4r3 00 
00 
15 
ro > ro — 4r3 00 
00 
00 
15 
00 
00 
r4 > 304 0 0 
rı > rı + 3r4 15 
rə 9 rə + 2r4 00 
rs => r3 = r4 00 
00 


Oro ccorc o0oO0reO OoOoO0reO ooO0omO 


© 


Solutions to exercises 


0 2—3 5 
4 3 2 10 
2 =6 =2 10 
0 0 5 5 
0 2 —3 5 
43 2] 10 
L3. oll 5 
00 5 5 
0 2-8 5 
0 —9 —2]} —10 
1 3 1 5 
0 0 5 5 
0 2-8 5 
0 =9 =2 1], —10 
1 3 1 5 
0 0 1 1 
0 20 8 
0-9 0} —8 
1 30 4 
0 01 1 


This is the row-reduced form of the matrix. 


(b) Strategy C1 gives the following sequence of 


row operations. 


Your sequence may differ from this because in the 
first step shown below (which corresponds to 

step 2 of the strategy) row 1 and row 5 are 
interchanged, whereas row 1 could have been 
interchanged with another row. However, your 
final row-reduced matrix should be the same as 
this one, since (as you will see in Theorem C1) the 
row-reduced form of a matrix is unique. 


rı 0 
ro —1 
r3 —1 
r4 2 
r5 1 
Mors I 
—1 

=l 

2 

0 


8 


= 


o0 œ œ © A AA œ œ 


8 =14\ -14 
—4 -6] -11 
—12 8 3 
O 24 34 

0 14 19 

0 14 19 
—4 -6] -ll 
12 8 3 
0 24 34 

8 —14/ -14 
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1 4 0 14 19 
Yo > ro + 1] 0 4 —4 8 8 
r3 > r3 + ri 0 12 —12 22 22 
r4 > r4 — 2ri 0 0 0 —4 —4 
0 -8 8 -14/ —14 
1 4 0 14 19 
r2 > 4r2 0 1 -1 2 2 
0 12 -12 22 22 
0 0 0 —4 —4 
0 —8 8 —14/ —14 
rı > rı - Aro 1 0 4 6 1i 
0 1 —1 2 2 
r3 > r3 — 12rə 0 0 0 -2 —2 
0 0 0 -4] —4 
r5 > r5 + 8r2 0 0 0 2 2 
1 0 4 6 11 
0 1 -l 2 2 
r3 > —4r3 00 0 1 1 
0 0 0 -4] —4 
0 0 0 2 2 
rı > rı - 6r3 1 0 4 0 D 
Yo > ro = 2r3 0 1 -1 0 0 
0 0 0 1| 1 
r4 > r4 + 4r3 0 0 0 0] 0 
r5 > r5 — 2r3 00 00/0 
This is the row-reduced form of the matrix. 
Solution to Exercise C13 
We have 
1 3 1 2 € 
Yo T 2 =i —1 1 4 5 9 
03 4 9/ 16 


The row operation has created a 1 in the correct 


position in the current row, but it is not a 
leading 1 because it has changed the 0 at the 


beginning of the row to —1. Performing this row 
operation has destroyed the progress made so far 
on the matrix: the first column no longer contains 


a leading 1 with only zeros above and below. 


Solution to Exercise C14 


We follow Strategy C2 and row-reduce the 
augmented matrix. 


rı 1 —4 —4 3 6|2\ 4 
ro 2 —5 —6 6 9/3) 9 
rs 2 4 09 2/0/ 17 
1 —4 -4 3 6| 2\ 4 
ro > ro — 2rı 0 3 20 =8/—1) 1 
r3 > r3 — 2r, 0 12 8 3 —10|—4 9 
1 —4 —4 3 6] 2\ 4 
ro > ar 0 1 20 -1)-$] 4 
0 12 & 3 —10|—4) 9 


(Note that here we cannot find a row operation 
that could be performed instead of rg > iro to 
create a leading 1 while avoiding fractions.) 


rı > rı + 4ro 1 0 -43 2| A 2 
01 4 0 -1/-$] 4 
r3 > r3 — 12rə 00 03 2 0 5 
1 0 -43 2| A 2 
01 20 -1/-$] 4 
r3 > irg 00 01 3) of 3 
ry > rı — 3r3 10-30 O| \ 4 
01 20 -1)/-4] 4 
00 01 3] 0/ 3 


This matrix is in row-reduced form. 
The corresponding system is 


Ti = 423 =% 
T2 + $23 — t5=-3 
£4 + 205 ="); 
that is, 
Ly 2+ $23 
£2 = —4 — frz + 25 
t4 = — 225 


Setting x3 = k and z5 = l (k,l € R), we obtain the 
general solution 


zı = $ + $k, 

a =—4— k+l, 
t3 = K, 

t4=—-3 


Solution to Exercise C15 
Fee) eres, 
mG i+tla w-G ws) 


(c) This sum is undefined since the matrices are 
of different sizes. 


0 6 -2 1 29 
(a) it 8 2|+|1 04 
03 4 3 —4 1 

1 87 

=|2 86 

3 -1 5 


Solution to Exercise C16 


(a) This difference is undefined since the matrices 
are of different sizes. 


5 8 12 3 10 2 

a (; 2 Ta 9 a 
_ (2 -2 10 
(8 -7 -22 


Solution to Exercise C17 


5 -3 20 —12 
(a) 4A=4{ 2 3ļ|=| 8 22 
sf 0 at 0 
2 1 8 4 
(b) 4B=4|-2 -7| =|-8 -28 
3 5 12 20 
a =12 8 4 
(c) 4A+4B=] 8 12] + [-8 -28 
—4 0 12 20 
28 -8 
=| 0 -16 
8 20 


5 —3 2 1 
(d) A+B= 2 37+ |-2 -7 


Solutions to exercises 


thus 
7 —2 28 —8 
4(A+B)=4/0 -4]= 1] 0 —-16 
2 5 8 20 


(Note that 4(A + B) = 4A + 4B.) 


Solution to Exercise C18 


(a) We add corresponding entries of the three 
matrices A = (a;;), B = (bij) and C = (qj). The 
(i, 7)-entry of the matrix A + (B + C) is 

Qij + (bij + Gij); and that of (A + B) +C is 

(aij + bij) + aj. Now, aij, bij and cij are real 
numbers, so aij + (bij + cij) = (aij + bij) + Gy. 
Therefore 


A+(B+C)=(A+B)+C. 


(b) We add corresponding entries of the two 
matrices. The (i, 7)-entry of the matrix A + 0 is 
aij +0 = aij. Therefore A+0O= A. 

Matrix addition is commutative (property A5), so 
0+ A= A also. 

(c) Let A = (aij), so —A = (—ajj). We add 
corresponding entries: the (i, 7)-entry of the matrix 
A+ (—A) is aij + (—aij) = 0. Thus the matrix 

A + (—A) is the zero matrix 0. 


Matrix addition is commutative (property A5), so 
—A +A = A + (—A). Thus —A + A is also the 


zero matrix 0. 


Solution to Exercise C19 

Let A = (a;;) and B = (bij). Then the (i, j)-entry 
of k(A + B) is k(aij + bij). 

Now, kA = (kaij) and kB = (kbj;), so the 

(i, 7)-entry of kA + kB is kaj; + kbij = k(aij + bij) 
since aij, bij and k are real numbers. 

The (i, j)-entries of k(A + B) and kA + kB are 
equal. Thus 


k(A +B) = kA + kB. 


Solution to Exercise C20 


(a) The product of a 3 x 2 matrix with a 2 x 1 
matrix is a 3 x 1 matrix: 


2 -1 4 
0 3 (3) =1|6 
1 2 7 
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(b) The product of a 1 x 2 matrix with a 2 x 2 
matrix is a 1 x 2 matrix: 


(2 1) c 5) =@ 14). 


(c) This product is not defined, since the first 
matrix has 1 column and the second has 2 rows. 


(d) The product of a 2 x 1 matrix with a 1 x 3 
matrix is a 2 x 3 matrix: 

—4 

ae 


(a) e 0 -9=(5 o 


(e) The product of a 2 x 3 matrix with a 3 x 3 
matrix is a 2 x 3 matrix: 


312 —2 0 1 
051 1 3 0 
4 1 1 


Solution to Exercise C21 
(a) We first prove the if statement. 


Suppose A and B are square matrices of the same 
size, then the product AB can be formed because 
A has the same number of columns as B has rows. 
Likewise, the product BA can be formed. Both 
the products AB and BA will be square matrices 
the same size as A and B. 


We now prove the only if statement. 


Suppose the products AB and BA are the same 
size, and suppose A is an m x n matrix and B is a 
px r matrix. 


Since the product AB is defined, then we must 
have n = p, and therefore the product AB is an 
m x r matrix. 


Since the product BA is defined, then we must 
have r = m, and therefore the product BA is a 

p x n matrix. 

Since the products AB and BA are the same size, 
m = p and r = n, but this combined with n = p 
and r = m, implies that p = r = m = n. Therefore, 
both A and B are square matrices of the same size. 


(b) Let A = ({ o) and B = ¢ Then 


in this case. It follows that matrix multiplication is 
not commutative even for square matrices of the 
same size. 


(There are infinitely many possible examples here; 
however, the trick when looking for a 
counterexample is to do as little work as possible: 
setting several of the entries to zero makes the 
multiplication easier!) 


Solution to Exercise C22 


The product of a 2 x 2 matrix with a 2 x 2 matrix 
is a 2 x 2 matrix. 


wa YG -Cia 
mai DG J- 


Note that AB and BA are equal in this case. 


(c) Matrix multiplication is associative, so 
ABC = (AB)C 


“(66 2C 9) a) 
7 e a l 
~ e an) 


(If you worked out = A(BC) then you would have 
got the same final answer here.) 


Solution to Exercise C23 


1 
(a) The matrix | 0 
0 


O Ne 


1 
2 | is upper triangular. 
3 


(b) The matrix is diagonal (so it is also 


9 0 
0 0 
both upper and lower triangular). 


0 0 1 
(c) The matrix |0 1 2| is not diagonal, upper 
k 23 


triangular or lower triangular. 


(d) The matrix a i is lower triangular. 


Solution to Exercise C24 


The (i, j)-entry of the product ImA is obtained by 
multiplying each entry in the ith row of Im by the 
corresponding entry in the jth column of A and 
adding the results. Now, the ith row of Im has a 1 
in the ith position and zeros elsewhere. Therefore 
the only non-zero term in this sum is the ith entry 
of the jth column of A, that is, the (i, 7)-entry 

of A. Thus IA = A. 


The (i, j)-entry of the product AI, is obtained by 
multiplying each entry in the ith row of A by the 
corresponding entry in the jth column of I, and 
adding the results. Now, the jth column of I, has 
a 1 in the jth position and zeros elsewhere. 
Therefore the only non-zero term in this sum is the 
jth entry of the ith row of A, that is, the 

(i, 7)-entry of A. Thus AI, = A. 


Solution to Exercise C25 


(a) The transpose of a 3 x 2 matrix is a 2 x 3 
matrix: 


T 
: ‘ er 
“e.g 4 2 10 


(b) The transpose of a 3 x 3 matrix isa 3 x 3 
matrix: 


21 A? A 04 
o0 3 -5| =1]i 37 
47 0 2 -5 0 


(c) The transpose of a 1 x 3 matrix is a 3 x 1 
matrix: 
10 
(10 4 6) =| 4 
6 


(d) The transpose of a 2 x 2 matrix is a 2 x 2 
matrix: 


T 


Solutions to exercises 


Solution to Exercise C26 
(a) Here, 


r sae. 
Pa 


r_(7 91 
i -( 10 a) 


and 
8 10 
A+B= 1/12 14 
16 18 
So 
8 12 16 
Ta 
eer) =(15 14 a 
and 


i go 7 91 
T T 
aT+BT= (0 alt (s 10 i] 
_ (8 12 16 
~\10 14 18 


= (A+B). 


So 


acy" = (5 i ne 


The product ATCT cannot be formed, since AT 


a 2 x 3 matrix and C7 is a 2 x 2 matrix. 
The product C7 A” does, however, exist: 


penr fk Vet. 3.5 
a. 2 4 6 
(2-7 ti 
~\o 4 6 


= (AC). 
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Solution to Exercise C27 


Suppose, for a contradiction, that there exists a 


matrix B = 


1 -l 
—1 1 


Multiplying the matrices on the left-hand side 


gives: 


a-c 
—a +c 


Looking at the entries in the first column, we must 
have a — c = 1 and —a + c = Q, that is, a— c = 1 
and a — c = 0. This contradiction shows that there 
exists no such matrix B. (The same conclusion 
arises from looking at the entries in the second 


column.) 


Solution to Exercise C28 
The equation II = I shows that I is invertible, with 


inverse I. 


Solution to Exercise C29 


To prove that AB is invertible, with inverse 
B-!A~1, we have to show that 


(AB)(B-'A~') = I = (BATH (AB). 


By the associative property (M2), 
(AB)(B-1A~') = A(BB"')A7! 


and, similarly, 


(B-'A~')(AB) = B7!(A7!A)B 


Therefore AB is invertible, with inverse BATH. 


l such that AB = I, that is, 


Solution to Exercise C30 
(a) We row-reduce (A |T). 


rı 


G 


1 
r2 > ro — 4rı 0 


1 
ro —> -—šr2 0 


rı > rı — 2r2 


0 


O NIN 


CO NIN 


Nio NIN 


= 
sJ 


ial 
~io e 


The left half has been reduced to I, so A is 
invertible; its inverse is 


| 
= 
Il 
oS 
l 
NSIN Tj- 
l 
NFR Ni 
Ni 


(b) We row-reduce (B | I). 


rı 
r2 
r3 


rə > rə2— 2r] 
r3 > r3 +3rı 


ro > =T3 


rı > Tri = T2 


r3 > r3—2rə 


ri Tr 2r3 
> —7 foe 2r3 


—4 


Ee OCF 


l 
N 


e Ub m o U m W 


l 
w 


0 
=] 


NOwo å yere. OeO Oro OF OQO 


3 


5 
6 
3 


eN DYV Foo FOO FOO KF OO 


| 
| 
| 
| 
| 


The left half has been reduced to I, so B is 


invertible; its 


BS 


1 1 
2 1 
—3 -l 
if 1 
0 -l 
0 2 
1 1 
0 1 
0 2 
1 0 
0 1 
0 0 
1 0 
0 1 
0 0 
inverse is 
—3 5 2 
0 3 2 
—1 2 1 


(c) We row-reduce (C | I). 


rı 2 4 6| 1 0 O*/\13 
ro 1 2 4|0 1 0ļ8 
r3 5 10 S| 0 © i) 21 
rı > $r 1 3|) 4 0 0\# 
1 4) 0 1 0f8 
5 10 5| 0 0 1/21 
1 2 3/ 4 0 QÀ # 
Yo —> Y2 — ri 0 0 1 -4 1 0 3 
r3 > r3— 5r 0 0 -10;}-3 0 = 


The usual strategy for row-reduction has created a 
leading 1 in the second row that does not lie on the 
main diagonal of the left half. Hence the left half 
cannot reduce to I, and therefore C is not 
invertible. 


Solution to Exercise C31 


The matrix form of the system is 


1 1 N fz 1 
-1 0 -4]ly)=[ 2 
3 2 i0/ \z =i 


Multiplying this equation on the left by the inverse 
of the coefficient matrix gives the solution 


x en 1 0 

y)={-1 2 1 =| 23 
1 1 1 

Z “Loy 3/ \l -3 


that is, 7 = 0, y = 2, z = — 


Solution to Exercise C32 


@ (oG 2 =G 2 4) 


elementary A matrix 
matrix obtained when 
associated with rı > 5rı 
rı > 5rı is performed on A 
1000 1 2 1 2 
01 0 3 3.4 24 28 
(b) 001 0 5 6 5 6 
0001 7 8 7 8 
elementary B matrix 
matrix obtained when 


associated with 
r2 > r2 + 3r4 


ro > r2 + 3r4 
is performed on B 


Solutions to exercises 


Solution to Exercise C33 


(a) The inverse elementary row operation of 
rı > rı — 2ro is rı > rı + 2rə. 


The working below shows the sequence of two row 
operations performed on A. 

3 

6 


rı il 2 
r2 4 5 
ri >> ri = 2r2 —7 —8 —9 
4 5 6 
2 3 
5 6 


(b) The inverse elementary row operation of 
rı © rə is rı Oro. 


rı > rı + 2re ( 1 
4 


The working below shows the sequence of two row 
operations performed on A. 


rı 1 2 3 
TQ 4 6 


5 
ri e rə 4 5 6 
1 2 3 
ri <> To 1 2 3 
4 5 6 


(c) The inverse elementary row operation of 
rə > —3r2 is rg > — ire. 


The working below shows the sequence of two row 
operations performed on A. 


rı 1 2 3 
r2 4 5 6 
1 2 3 
—12 —15 -18 
1 2 3 

4 5 6 


Solution to Exercise C34 


ro > —3r2 


ro: —$r2 


Matrix A has associated elementary row operation 
rı — 2r,, which has inverse rı —> iri. The inverse 
of A is the elementary matrix associated with this 
inverse row operation, which is 


1 

5 0 0 

A'‘t=|/01 0 
001 
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Solution to Exercise C35 


(a) ; J = (6x 2)- (x4) =6 


(b) = E = (10 x 2)— (—4 x (—5)) =0 


7 3 
(c) liz 9 


|= (7x2) - (x10) =-37 


Solution to Exercise C36 


(a) First we evaluate the determinant of the 
matrix: 


4 2 


5 6G = (4x 6) — (2x 5) = 14. 


This determinant is non-zero, so the matrix is 


invertible. We use the formula to find the inverse: 


4 2\~"_1/6 -2 
5 6)  4\-5 4 
7 7 
5. 2}° 
14 7 


(b) First we evaluate the determinant of the 
matrix: 

1 ql 
=] 1 


|=axD-0xD)=2 


This determinant is non-zero, so the matrix is 


invertible. We use the formula to find the inverse: 


NIe wle 


Ce n. 


(c) First we evaluate the determinant of the 
matrix: 

1 -l 
=] 1 


[=x 1)-C1x (9) =0. 


This determinant is 0, so the matrix is not 
invertible. 
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Solution to Exercise C37 


(a) We have 
3 2 1 
4 0 =l 
0 —1 1 
0 —1 4 -1 4 0 
-ofi a-e aeh = 
= 3((0 x 1) — (-1 x (=1))) 
— 2((4 x 1) — (-1 x 0)) 
+((4 x (—1)) — (0 x 0)) 
ZET: 
(b) We have 
2 10 0 
3 —1 2 a -of +0 
5 9 2 


= 2((—1 x 2) — (2 x 9)) 
— 10((3 x 2) — (2 x 5)) 
=0 


Solution to Exercise C38 


The cofactor A13 is (—1)!t3 = (—1)4 = 1 times the 
determinant of the submatrix obtained by 
removing the top row and third column of A: 


2 35 


1 

3 2 

Ai |) 5 3 
5 1 4 


w Ne 


The cofactor Ags is (—1)4+° = (—1)? = —1 times 
the determinant of the submatrix obtained by 
removing the fourth row and fifth column of A: 


1234 


2 
Ass =- |3 


5 


= A ù% 


4 5 
5 1) 
2 3 


Solutions to exercises 


Solution to Exercise C39 We have (det A)(det B) = 10 x 7 = 70, and so 
We apply Strategy C5: det(AB) = (det A)(det B). 
0-2 is ; ; 
-3 0 0 -1 Solution to Exercise C41 
l0- 1- 0 (a) We apply Strategy C5: 
0 4 2 0 010 T 
3 0 1 3 0 1 1 o of =0-| i+ 
sg- 11 of+]/10 0 001 y 
02 o |04 0 we 
—3 0 0 
(Ay 4: 6-4 (b) We apply Strategy C5: 
0 4 2 1 0 0 0 100 
0 1 00 
=-2(-3|; -0+6 1) 0 0 k ol |, : Fai 
0 0 0 1 
0 0 1 0 
+(-3[f o -0+ il) _ o [-o+9 
0 1 
0 1 
+ (3l; a -0+0) a 
= (—2)(—2) + (—1)4 + (—3)(—4) _ 
=s'{9: (c) We evaluate the determinant: 
1 0 
. š =(1x1)-(0xk 
Solution to Exercise C40 p a ) 
Here, =1. 
—3 1 i i 
det A=] 3 4 Solution to Exercise C42 
= (—3 x (—4)) — (1 x 2) = 10, First notice that 
—2(1 —2 4)=(-2 4 -8), 
nal } ( r= ) 
j that is, the first and third rows of A are 
= (1x 5)— (1 x (-2)) =7 proportional. Therefore, by Theorem C16, 
and 


det A = 0. 


det(A + B) = (—2 x 1) — (2 x 0) = -2. 


We have det A + det B = 10+ 7 = 17, and so 
det(A + B) is not equal to det A + det B. 


— 2 
ae G a 


det(AB) = (—5 x (—18)) — (2 x 10) = 70. 


SO 


101 


Unit C1 Linear equations and matrices 


Solution to Exercise C43 


We interchange the first and third rows, and apply 
Theorems C14 and C15, giving 


10 3 —4 2 06 00 
02 01 02 01 
dA 6.6 0 ol | 40 3 —4 9)’ 
—1 2 1 0 —1 2 1 0 
We use Strategy C5 to evaluate this determinant: 
0 0 1 
det A = (—1) | 0—6/10 —4 2|+0-0 
—1 1 0 


10 —4 
=6(0-0+/") 1) 


= 6 ((10 x 1) — (—4 x (—1))) 


= 36. 
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